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ABSTRACT 


This memorandum, which is in two parts, describes some recent 
developments in the design of correlation computers. 

In the first part , the underlying theory of the correlation 
function and its calculation are summarized; and the effects of 
finite averaging time, sampling, and quantization are discussed. 
Theoretical analysis, based on the work of Widrow, and experi¬ 
mental evidence are introduced to show that for many applica¬ 
tions no significant change occurs in the correlograms for 
quantization above 4 or 8 levels, contrasting sharply with the 
previous practice of specifying 100- to 200-level quantization. 
For certain applications, even two-level quantization yields 
significant results. A classification of types of correlation 
computers is introduced and is followed by a detailed survey 
and description of the many components and circuits which may 
be used to perform the required mathematical operations. Using 
the component survey as a basis, two correlator designs for a 
particular requirement - one analog and the other analog- 
digital - are outlined and discussed in detail. A comprehen¬ 
sive bibliography is included. 

The second part of the memorandum concerns the design and 
operation of a two-level real-time correlator. This correlator, 
which was constructed to experiment with two-level quantization, 
is designed around the ability of the magnetic-core shift regis¬ 
ter to accept and store, in time sequence, information whioh 
has been given in the form of the binary digits ONE and ZERO. 

Inputs in analog form are sampled and quantized to two levels 
(one bit) and inserted into a ten-element shift register. 
Parallel outputs from all cores are multiplied by the output 
of the last core, thus forming products with different time 
displacements. The products are averaged in low-pass filters, 
and the resulting ten-point correlogram is displayed continu¬ 
ously on an oscilloscope or with a voltmeter. The correlator 
was tested with periodic and random inputs, and the evaluation 
of the results indicates the practicality of two-level quanti¬ 
zation and the possibilities for real-time electronic 
correlation. 


iii 



ACKNOWLEDGMENT 


In addition to the authors, other laboratory staff members who 
contributed, through consultations or direct assistance, to 
the research reported in this document are Mr. Harry Pople, 

Mr. Douglas Ross, and Professor A. K. Susskind. Their help is 
gratefully acknowledged. Mr. John E. Ward has served as editor 
for the completed document. 


v 



FOREWORD 


The material in this memorandum is the result of two different 
studies made during 1957 in the Servomechanisms Laboratory. 

The material in Part I is adapted from a study, "Correlation 
Computer Design Studyby J. F. Kaiser performed for the 
Communication Biophysics Group of the Research Laboratory of 
Electronics, M.I.T. Funds for this work were provided by the 
Caspary Research Grant to M.I.T. Although this study was made 
for a particular correlation application (bio-electric poten¬ 
tials), the excellent summary of basic theory and techniques 
makes it valuable for any correlation problem. Those portions 
of the study which are of general interest have been adapted 
for use in this memorandum,, and only the specific design 
details of a correlator for the bio-electric application have 
been omitted. Permission of Professor W. A. Rosenblith of the 
Research Laboratory of Electronics for use of this material is 
gratefully acknowledged. 

The material in Part II is a study performed as a Master 1 s 
Thesis by Mr. R. K. Angell and supported by the Air Force under 
Contract AF33( 6 l 6 )-3950• This thesis was a direct outgrowth of 
the study in Part I and was undertaken in order to demonstrate 
the practicality of a two-level real-time correlator, sometimes 
referred to herein as a "one-bit correlator". The thesis was 
supervised by Mr. J. F. Kaiser. The equipment was constructed 
solely to demonstrate the principle, and its success indicates 
that two-level correlators of this type could be designed for 
many correlation problems and would have great advantages in 
speed and complexity over existing methods. 

This work has been supported as part of the airborne data- 
processing studies under Task 50^78 of Contract AF 33 ( 6 l 6 )-395° 
because of the growing significance of correlation techniques 
in modern information processing. Correlation techniques are 
appearing in more and more of the literature concerning recon¬ 
naissance, intelligence, identification and location of unknown 
electromagnetic transmissions, and transmission of information 
at signal-to-noise levels much less than unity. The material 
should be of interest to anyone performing correlation analysis 
of data of any kind. 


John E. Ward 
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PART I 


CONSIDERATIONS IN THE DESIGN OP CORRELATION COMPUTERS 


by 


James F* Kaiser 



CHAPTER I 


INTRODUCTION 

This study of schemes for realizing the correlation 
computation was undertaken to review the present state of the 
art of computation, both analog and digital, and to review 
the theory of the basic correlation computation as a statisti¬ 
cal tool with the intended goal of arriving at the correlation 
computer design which will best suit the requirements of its 
users. The most important design considerations are speed and 
accuracy of computation, versatility and reliability of its 
operation, and the economy of construction and operation. In 
short, what is desired is the fastest, most accurate, simple, 
and reliable correlation computer. 

In choosing a method for correlation computation, it is 
apparent that the choice must depend heavily upon the form of 
the input data , the form desired of the output data , and the 
time scale of the data-~considerations which arise in the use of 
the machine. To permit the most flexibility in the choice of a 
design or method of computation, we have chosen to separate the 
overall problem into two parts. The first part concerns that 
of properly applying the correlation computer to a data reduc¬ 
tion task. Considerations are those of accuracy and those of 
the choice of the length of data to be correlated and the num¬ 
ber and time separation of the computed correlation values. 

The second part concerns the design of a correlator which will 
perform the single correlation computation as rapidly is 
possible. 

This study is arranged into three sections. The first 
section deals with the theoretical concepts of correlation. 

The effects of finite averaging time, sampling, quantization, 
and averaging method are discussed. Spectral analysis is also 
considered. In the second section, the discussion centers on 
the various schemes used for correlation computation with 
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emphasis on their inherent advantages and disadvantages in 
respect to our problem specification. The components used to 
realize the individual operations are examined in detail. Con¬ 
clusions as to design are stated in the third section. 



CHAPTER II 


THEORETICAL ASPECTS OF CORRELATION ANALYSIS 


A. THE CORRELATION FUNCTIONS 

The correlation functions that provide the basis for the 
analysis of random time functions are defined ( 15 )* as 

+T 


<Pi 2 (t ) - 


'Pu ( t) = 


lim 
T—*oo 


lim 
oo 


C f 1 (t)f 2 (t+T)dt 

-T 


+T 


w I 

-T 


f 1 (t)f 1 (t+T)dt 


(crosscorrelation) 


(autocorrelation) 


If f^(t) and fg(t) are integrable square (which is almost 
always met in practical situations), then cp 12 <T) and c Pi 1 ( T ) 
are defined for all t and possess Fourier transforms that are 
commonly called power-density spectra. These spectra are 
respectively 
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(complex cross-power- 
density spectrum) 


(power-density spectrum) 


In using correlation techniques, some investigators prefer 
to base their analysis on interpretation of the relevant corre¬ 
lation functions, while others prefer interpretation of the 
spectral functions. Disregarding for the moment the relative 
merits of each method, the literature appears to be in general 
agreement that computation of spectra is most readily accom¬ 
plished from the correlation functions rather than from the 
data directly. With this opinion as a basis, we shall now 
consider the computational problems that exist in the practical 
calculation of ftihe correlation functions. 

* Number in parentheses refers to numbered items in the 
Bibliography. 
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The integral expressions for the correlation functions are 
seen to be based on a time averager This requires that the 
time function being correlated must be one generated from a sta 
tionary process, ire., a process whose statistical characteris¬ 
tics are time invariant. If the time function is not station¬ 
ary, interpretation of the correlation function in its simple 
form becomes difficult if not impossible. 

The correlation integration is carried out over limits 
tending toward infinity. Thus, information over all time is 
required of the time function. Practically, this is impossible 
and one must be satisfied with analysis of a finite amount of 
data. The questions which arise are what is the effect of a 
finite averaging time and what is the effect of using an imper¬ 
fect integrator to perform the integration operation? 

Because of the availability of high-speed digital comput¬ 
ing machines, the investigator must be acquainted with the 
problems and effects of the sampling and quantization opera¬ 
tions on the time functions, these operations being required 
on the data for digital computations. 

This section will treat these problems in sufficient 
detail to give the investigator Some idea of the magnitude and 
type of error introduced by each. 

B. TIME SERIES CHARACTERISTICS 

The use of the time average in the calculation of the 
correlation functions assumes most heavily that the^time func¬ 
tions have statistical characteristics that are time invariant. 
From the practical point of view, such stationary time func¬ 
tions are not met exactly in most physical processes. By con¬ 
tinuously monitoring the data, one often observes both bursts 
of variation and relative changes in the level of variation. 

It is then necessary to decide whether to correlate over short 
periods where the variation level appears to be relatively 
constant , or to correlate over a very long period and obtain an 
average correlogram for the process. If the latter correlation 
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is chosen, much longer computation time is required; and it is 
necessary to interpret the effects of averaging the different 
levels of variation. On the other hand, if short correlations 
are taken, a view of how the correlation changes with level of 
variation is obtained at the sacrifice of slightly higher 
variance of error. 

Provided the length of record of the short runs is at 
least an order of magnitude (factor of ten) greater than the 
period of the lowest frequency or time constant of the process 
other than those corresponding to changes in level of variation, 
then the average correlation for the process may be obtained by 
simply adding and averaging the short-time correlations. This 
second method of looking at several short-time correlations has 
several important advantages over computation of one long-time 
correlation. First, it gives one more of a feel for the 
effects of change in activity on the correlation,. Second, it 
may result in important savings in computation time if it is 
shown early that the short term correlations differ only 
slightly from one another. This factor is extremely important 
from an economic point of view since it is desirable to obtain 
as much interpretable information as possible from a unit of 
computation time. 

In support of the ideas just discussed, reference is made 
to Figs. 1 and 2, which show two common types of correlogram 
(correlation function) characteristics,* In each figure the 
correlogram at the top was obtained from a 60~second run length. 
The second and third correlograms correspond to computation 
over the first 7~l/2 seconds and the last 7/12 seconds, respec¬ 
tively. The change in correlogram characteristics with time is 
most obvious. For example, in Fig. lc the apparent modulation 

* These particular data, which were obtained from physical 

experiments on cell potential activity in the human body, are 
used because they are typical of the data to be correlated 
in many applications and also because they were readily 
available. These same sets of data are used throughout this 
report when recourse to an example is necessary to illus¬ 
trate a point in discussion. 
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Figs. 1 and 2 Variation in the Autocorrelation as a Result of 
of Time Varying Statistics 
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of the periodic component is missing whereas both Figs, la and 
lb show this phenomenon clearly. Likewise, from Figs. 2a, 2b, 
and 2c, the first 7-l/2 seconds of data gives a much more varia 
ble oorrelogram than does the last 7-1/2 seconds of data. The 
last 7-1/2 seconds of data, however, gives a oorrelogram having 
much the same features as the long 60 -seoond correlation. 

These examples point out clearly the advantages to be gained 
in short-term correlation and what sacrifices are made to 
obtain them. 

One source of error in correlation that results from non¬ 
stationary series is oaused by drift or very slow change in the 
value of the mean of the signal. This slow variation can be 
removed by coupling the signal to the correlator through a high 
pass RC filter. The break frequency of this filter is chosen 
to be lower than the lowest frequency of interest in the corre¬ 
lation by at least a faotor of two. Filters of identical 
characteristics should be used in each of the two input chan¬ 
nels to the correlator. 

C. EFFECTS OF FINITE AVERAGING TIME, SAMPLING, AND IMPERFECT 
INTEGRATION ON THE ACCURACY OF THE CORRELATION 

The accuracy of the correlation computation depends on the 
averaging time interval, the number and spacing of samples if 
sampling techniques are used, and the characteristics of the 
integrator or averaging device. Much material has appeared in 
the literature discussing in detail the first three items (l4, 
15, 16, 17. 19. 20, 21, 24), Of these references, (20) gives 
perhaps the most complete and readable discussion of these 
effects. 

From the literature, the following general conclusions can 
be drawn. For random signals the rms error in the correlation 
determination varies to a first approximation inversely as the 
square root of the record length. For periodic or determinis¬ 
tic signals the rms error varies inversely as the first power 
of the record length. Exact determination of the rms error in 
the correlation computation requires knowledge of not only the 
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precise correlation function for the process but also of the 
fourth-order probability density distribution. Hence, exaot 
determination of rms error can be made for only the simplest 
theoretical cases. 

If one assumes a fixed data length, calculation of the 
correlation function by the use of samples and summation 
results in a higher value of rms error than if the computation 
were done continuously. This is easy to understand if one 
looks upon the sampling operation as discarding some of the 
information in the data. The rms computation error for the 
sampled case varies inversely as the number of samples for 
deterministic signals and inversely as the square root of the 
number of samples for the random signals. These variations are 
approximate; exact calculation of error again requires knowl¬ 
edge of both the second- and,fourth-order probability distribu¬ 
tions of the input data. 

If the integration required in the correlation computation 
is to be accomplished approximately by the use of a filter, 
then in general a longer record length is required for the same 
accuracy of computation. 

We can therefore conclude (neglecting- inaccuracies in the 
components) that for a specified accuracy of correlation compu¬ 
tation the speed at which the computation can be carried out is 
directly dependent on the speed at which the data can enter the 
computation. For a fixed data speed, the continuous-type 
correlator utilizing a pure integrator gives the most accurate 
result. 

Because calculation of the variance requires knowledge of 
both second- and fourth-order probability distribution func¬ 
tions of the signals, the exact evaluation of the variance for 
a practical case becomes very difficult. To give some standard 
against which one oan approximately assess the variance for 
practical cases, the signal can be assumed to be band limited 
noise such as would be obtained if white noise were passed 
through a low-pass filter. 
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The autocorrelation function of suoh a signal is given by 

, . .. 2e ‘"a l T I 

9 f ( T ) = e 


where <r = mean square value of the signal 
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Figure 3 shows graphically the rms computation error <r cp 
as a function of the record length for both t = 0 and w t »1. 
'the rms error value as determined from this graph represents 
an uppei* bound on the rms error that is encountered in prac¬ 
tical situations. This rms error value refers only to the 
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Fig. 3 RMS Computation Error as a Function of Record Length 

calculation of single points on the correlation curve. From 
knowledge of this error value, little can be inferred about how 
the shape or overall characteristics of the correlation curve 
for a finite record length deviate from the true correlation 
characteristic. As A rule, the fit will be closer than that 
indicated by the value of the variance. 

For periodic signals the variance diminishes with the 
square of the record length. For example, if the signal is 
assumed to have the form 

f(t) = A cos(u t + 0) 

l \ a2 

=P f ( T ) = — COS <*)T 


then 
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The variance 

of cf>£ as a 

function of recor4 
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Thus, for wJL = nn, where n is an integer ^0 , the variance 
is equal to zero, As an upper bound to the rms error we use 
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A plot of this function is shown in Fig. 3 . Thus, for example, 
a record length of only 5 periods of the frequency w can result 
in a 2 . 2 % rms computation error, in the correlation coefficient 
as an upper rms limit. If we recall the correlation function 
of Fig. lc where a very pronounced periodioity of approximately 
W =6 3 radians/sec is present, it is easy to understand in one 
sense why the obtained correlation is so smooth. Lw for this 
case is 460 corresponding to a rms error of 0 . 15 % if the 
periodic component is assumed to be the only component of 
importance. 

One must be very careful in applying the results of these 
two simple oases to practical situations primarily because the 
processes usually encountered are nonstationary and of wide 
variability in statistical makeup. The two cases are presented 
only to sdrve as a broad guide. 

To give an example of how the results might be misleading, 
refer again to Figs, la and lb. There appears to be a marked 
modulation to the envelope characteristic of the periodic 
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component. This could be characterized by two signals of 
nearly equal frequencies beating with one another. The 
expression for such a signal component oould be written as 

f^(t) = cos id^ttl + a cos Wgt) 

or 

f^(t) = COS U)^t + “ OOS ) t + OOsiu^+lOgJt 

where In such a case it can be shown that the 

value of the variance of the computed correlation function is 
mostly dependent on the low frequency of the modulation. 

If the modulation is of very low frequency, extremely long 
record lengths must be used to reduce the theoretical variance 
to a tolerable value. We know from experience that extremely, 
long records are not required to show the presence of the modu¬ 
lation; yet from calculation of the variance alone, we may be 
seriously in error with only moderate record lengths. Prom 
the experience gained by different members of the Servomechan¬ 
isms Laboratory, the rule-of-thumb criterion that the record 
length should be at least 8 to 10 times the maximum time shift 
has been found to give very satisfactory results* 

If sampling techniques are used, the same rule applies 

to record length with the additional requirement that the 

3 

number of samples be at least 10^ and preferably greater than 
10 for good correlation results (3* 8* 15 )» 

D. SPECTRUM ANALYSIS 

Although the general or main characteristics of the 
autocorrelation function appear to be affected only slightly 
by the use of finite records of moderate length, the fact 
that errors or variability are present should caution the 
investigator in trying to read too much out of small irregu¬ 
larities in the correlation function. We feel that there is 
much to gain in understanding the information in the correla¬ 
tion if the spectrum or Fourier transform of the correlation 
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is studied. The spectral study would not be intended to 
replace the correlogram study, but instead, to augment it 
and thus add greater insight into the problem. 

Investigators using spectral graphs (18, 20, 22, 23) have 
found that the numerical computation of the spectra from the 
computed autocorrelation function can be carried out in general 
easier and faster than by the use of schemes involving band 
pass filtering and averaging of the original time function. 

This is especially true when use is made of special purpose 
analog or digital computers. Thus, the computation of spectra 
would follow logically the present computation of autocorrela¬ 
tion functions. 

The spectra, as are the functions from which they are 

obtained, are affected by the use of a finite record length. 

The most important effect is that of limiting the frequency 

resolution to a minimum possible value u of 

res 

0 ) = -—*— - 1 -s (Reference 18) 

res f 3 

L - ’T'T 

4 max 

■■’} ■/' ... 

where L is the record length and t is the maximum time 

max 

shift of the correlation function. This resolution is seldom 
achieved in practical cases because of the excessive amount of 
calculation required. In the more usual situation , the number 
of oomputed points of the spectral function is made equal to 
the number of computed values of the correlation function— 
usually in the range of fifty to two hundred points. In this 
case, the maximum frequency resolution obtainable in the 
spectrum is equal to the reciprocal of the maximum time shift 
of the correlation function. To realize this resolution, a 
special weighting function ( 23 ) is introduced in the trans¬ 
formation computation in order to reduce the effects of trun¬ 
cation of the correlation function. The introduction of the 
special weighting function adds little to the complexity of 
the Fourier transformation computation. The effects of the 
addition of this weighting function on the obtained spectral 
function is discussed in detail by Ross (23). 
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An example of the uso of spectra in the correlation 
studies will be pointed out in the next section where- the 
effects of quantisation are considered in some detail. 

E. QUANTIZATION AS APPLIED TO THE COMPUTATION OF CORRELATION 
FUNCTIONS 

lv Theoretical Considerations 

If it is first assumed that the data to be correlated is 
in a continuous analog form, then in order to perform the cor¬ 
relation computation digitally the data must first be sampled 
at discrete evenly spaced points and then the magnitude of the 
sample digitised or quantised. The effects of sampling have 
already been disoussed. The problem remains as to what 
effects does quantisation introduce. It would be advantageous 
to know how ooarsely one is permitted to quantise the data 
without introducing excessive errors in the correlation compu¬ 
tation. If a special-purpose digital maohine is to be built 
to perform the computation, it is known that the sise and com¬ 
plexity decrease and the speed increases as the sise (bit 
length) of the input number is reduced. It is then to one's 
advantage to use as small a number (as coarse a quantisation) 
as is tolerable in view of the errors introduced. 

The theoretical study of the effects of quantisation 
carried out by Vidrow (24) suggest that extremely coarse quan¬ 
tisation is permissible in the correlation computation with 
the resultant statistical errors being calculable. For simple 
first-order processes, it is shown that the noise introduced 
by quantisation is completely unoorrelated with the statistics 
of the process if a certain relation exists between the quan¬ 
tisation coarseness and the oharaoteristio funotion of the 
amplitude distribution of the input. If the relation is satis¬ 
fied, then the moments of all orders of the unquantised signals 
are calculable from the moments of the quantised signal and 
information on the quantisation coarseness. 

For higher-order processes the correlation between quanti¬ 
sation noise and quantised signal is a function of the 
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correlation of the quantizer input signal with itself. For 
signals with Gaussian distributed amplitudes, Widrow (24) 
gives the following relation that approximates closely the 
correlation of quantization noise as a function of the 
correlation coefficient of the quantizer input signal: 



where c= normalized correlation of quantization noise 
* with signal 

or = standard deviation of quantizer input signal 
q = quantization box width 

= normalized correlation coefficient of the 
quantizer input signal 

A plot of this relation for different values of the correlation 
of quantized noise is shown in Fig. 4. The use of this figure 
is as follows. If a box size or quantization coarseness of 
say q = 2<r is used, then one can, by reading off the inter¬ 
section of the slanting lines with the ordinates determined 
by ($>) = 4, obtain the correlation value of quantization noise 

to be expected for any normalized correlation coefficient of 
the signal being quantized. Thus, we see that for q = 2 g- 
(extreraely coarse quantization) the noise introduced by quan¬ 
tization is less than 1 % correlated with the signal for all 
correlation coefficient of the signal less than 0.1 in 
magnitude. 

Van Vleck* (68) has shown that for two-level quantization 
the correlation function R(t) of the quantized signal is simply 
related to the correlation function 9 (t) of the continuous 
signal as 

R( t ) = ~ sin 1 Ccp( t )] 

Thus, in the two-level case for correlation values less than 
0.54, R(t) is within 5$> of 9 (t). 

* A derivation of this result is included on page l4? of this 
memorandum. 


The importance of this result is immediate to the problem 
of correlation. If the noise introduced by the quantization 
process is completely uncorrelated, then the only effect of 
quantization is to change the values of the even moments of 
the input signal an amount calculable directly from the 



Fig. 4 Quantization Box Size vs. Correlation Coefficient of 
Quantizer Input Signal with Correlation of Quantization Noise 
a s a Parameter 

quantization size. All other obtained points on the correlation 
curve (i.e. f other than at r = 0) are theoretically unaffected 
by the quantization, a very interesting and useful result. A 
series of experimental tests, that will be mentioned subse¬ 
quently, were carried out which verified this theoretical 
result quite well. 

The errors in the even moments of the correlation for t = 0 
of the quantized signal are found simply by considering the 
flat-topped distribution of the quantization noise. This dis¬ 
tribution is shown in Fig. 5« The moments are given by 
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It must be recalled that these theoretical results assume 
that the distribution of amplitudes of the input signal or 
signals satisfies the !! Myquist Condition 1 ® with.respect to 
quantization size. Signals whose distributions are Gaussian 
or Very nearly Gaussian satisfy this condition approximately 
up to extremely coarse quantization » Fortunately, most of 
the data from the physical processes of nature have amplitude 
distributions that are approximately Gaussian . The distribu¬ 
tions which can cause serious errors when quantization is 
introduced are those possessing discontinuities or large 
changes in slope* Fig. 6 gives several examples of these 
types of amplitude distributions. 

2« Experimental Results 

To obtain a feeling for the implications of quantization 
and to test the validity of theoretical results, a series of 
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2 2 

Fig. 5 Probability Distribu¬ 
tion Function of Quantization 
Noise 




Fig. 6 Amplitude Distributions 
Not Satisfying the "Nyquist 
Condition” 


correlograms was computed with 
the aid of the Whirlwind ;I 
digital computer. The data 
were taken from tape record¬ 
ings of the cell potential 
activity during two different 
experiments. The correlograms 
of the data exemplified the 
two extremes encountered in 
this type of study. One, 
denoted by Run A, represents 
what appears to be a well- 
defined behavior; the other, 

Run B, a much more complex 
structure. 

The correlogram computa¬ 
tions were aimed at finding 
the effect on the correlation 
characteristics of quantiza¬ 
tion of varying degrees of 
coarseness and at determining 
the effects of bias and satu¬ 
ration that would occur in a 
practical realization of a 
quantized computation. The 
correlations were obtained 
from the summation of 65O 
products of sample pairs. 

Each correlation consisted of 
100 evenly spaced computed 
values. The sample size (650 
points) is regarded as small 
for this type computation (15). 
and hence care must be exer¬ 
cised in the interpretation of 
the results. 
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The first graph, Fig. 7 , shows the effect of quantization 
coarseness on the correlation characteristics of the Run B 
data. It is seen that quantization to 3 bits (8 levels) 
results in only minor amplitude differences with no apparent 
changes in overall characteristics. For 2 -bit (4 levels) 
quantization, the variations in amplitude deviation are some¬ 
what greater but still the general characteristics are retained 
For the extreme oase of one-bit (2 levels) quantization coarse¬ 
ness, Fig. 8 shows that only the major characteristics of cor¬ 
relation are intact. The theoretical results of the previous 
section indicate that better correlation should be obtained. 

The discrepancy between theory and experiment in this situation 
is believed to be due primarily to the small sample size. 

Aside from this, the results of one-bit quantization are quite 
startling and interesting. 

The comparison between correlations was made on the 
general basis of how closely the curves conform to one another. 
An additional check into the effects of the quantization is 
made by observing the power density spectra of the correla¬ 
tions. As shown in Fig. 9 , quantization down to three bits 
introduces no detectable changes in the frequency character¬ 
istics of the spectra. The minima and maxima appear unchanged 
frequency-wise. One-bit quantization appears to reduce the 
frequency definition as notable differences are present, 
especially at the higher frequencies. This, again, is believed 
due to the small sample size. 

The data of Run A was subjected to the same procedure as 
outlined above. Quantization was adjusted to be 8 bits, 

3 bits, 2 bits, and one bit, respectively. The results are 
shown ih Figs. 10 through 12. 

It is immediately apparent «that the same general 
conclusions as reached for rth.e Run B data apply here directly. 
Quantization to three bits causes no changes in the important 
characteristics of the ?,correlation and only slight difference 
amplitude variations. The spectra (Fig. 12 ) show that in all 
cases the apparent modulation of the cosinusoid is unaffected 
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Figs. 7 and 8 Correlogram, Run B 
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by coarseness of quantization. The only perceptible effect 
in the spectral study was that in the one-bit case the dis¬ 
crepancies were large primarily at the high frequencies. In 
all cases, the relative magnitudes of the two adjacent maxima 
at 8 and 10 cps were preserved. 



Fig. 9 Power Density Spectra, Run B 


From the similarity of results obtained from these tests 
on two sets of data of quite different correlation character¬ 
istics, it can be concluded that very satisfactory correlations 
can be computed digitally using quantization as coarse as 
8 levels (3 bits). Quantization to 4 levels (2 bits) appears 
to give good results and there is every indication that this 
result should improve if the sample size is increased to a 
moderate value. 

Because quantization to 2 levels (one bit) gives a 
surprisingly fair corroTation,work in the form of a master’s 
thesis was conducted toward the construction and evaluation of 
such a device which would compute and display ten values of 
the correlation function simultaneously. The results of this 
thesis are included in their entirety in Part II of this 
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memorandum. The one-bit correlator should prove very valuable 
as a simple and rather inexpensive device capable of giving 
good estimations of the correlation functions. 



Fig. 12 Power Density Spectra, Run A 

Because any practical design must utilize a quantizing 
element, a study was carried out to determine the effects of 
data bias shift and data-mean-square-value shift on the 
correlation characteristic when only a finite number of 
quantization levels are available. For the first run the 
"level" size or "box" width was chosen such that 98% of the 
data points fell within the total number of boxes to be used 
(3 and 7 for the Run B d&ta and 3 For the Run A data). Any 
data points falling outside the end boxes (top and bottom 
levels) were interpreted^ being inside the respective end 
box. This type of run* termed a "straight" run. A graph 
illustrating this adjustriie'ht of box width is shown in Fig. 13a 
for a nearly Gaussian 1 dlstribution of signal amplitudes. 
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Fig. 13 Changes Made in the 
Amplitude Distribution to Study 
the Effects of Bias, Amplifi- 
cation 'Factor and Saturation 


To determine the effect 
of a shift in bias and the 
resulting box saturation, a 
bias of one-half a box width 
was added to the data as 
adjusted for a straight run. 
The resulting amplitude dis¬ 
tribution over the boxes is 
shown in Fig. 13b. The effect 
being investigated by this 
maneuver is not only the 
resultant change in correlo- 
gram bias but the shape of the 
correlogram as determined by 
saturation in the end box B^. 

In order to try to 
isolate the effects of end box 
saturation,, the data of the 
straight run was multiplied by 
a constant factor such that 
of data points covered 
n + 1 boxes where they had 
covered n boxes before. The 
test was then run still using 
only n boxes. Saturation was 
thus present in both end boxes 
(the effective end box width 
thus being l-l/2 boxes). This 
operation is shown in Fig. 13c 

For a final run the ampli 
fied data of Run 3 was again 
shifted one-half a box width, 
thus doubly saturating the 
right end box and returning 
the left end box to roughly 
the unsaturated condition. 
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This manipulation is shown in Fig. 13d. Figure 13 was prepared 
using 3 levels for the quantization. 

Figure 14 illustrates the correlations obtained by 
applying the sequence of four manipulations to the Run A data. 
The first observation is that the general character, including 
the envelope modulation, of the correlation is retained 
throughout all the operations. At only three levels of quan¬ 
tization this result is very rewarding because it indicates 
that the bias and saturation effects are not extreme at all. 

The shift in correlation level for the second and fourth runs 
was approximately the value computed from the square of the 
bias set in. If the data had an initial mean value of f, then 
it can easily be shown that the change in correlation value 
for an added bias b is simply 2fb + b 2 . 

It is noticed that the effect of saturating the end boxes 
as in Run 3 gave a wider variation in the correlogram. This 
was to be expected since the end boxes are now being used more 
than in the first run. Despite the heavy saturation effect in 
the right end box for Run 4, the general correlation character¬ 
istic was quite well preserved. In all oases the major 
frequency information remained fixed in the spectrum. 

The same sequence of operations was applied to the Run B 
data first with quantization at 7 levels and then at 3 levels. 
The correlograms of Run B at 7 levels, Fig. 15, strongly 
support all the conclusions reached on the 3-level Run A 
results. At 7 levels the different correlations remarkably 
display all the moderate and major rises and falls of straight 
correlation. Amplifying the data as in runs three and four 
again results in a slightly increased correlation amplitude 
due to greater use of the end boxes. 

The correlograms of Run B at 3 levels showed much 
increased variability over that at 7 levels. For this reason, 
a power spectrum presentation of the results is chosen. 

Fig. 1 6 shows these results in detail. It should first be 
mentioned that the amplitude scale factor for runs two and 
four differs from that of runs one and three by a factor 
slightly greater than 2. 




Fig. 14 Correlogram, 3 Levels, Run A 



Fig. 15 Correlogram, 7 Levels, Run B 
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The first general comment is that the power density 
spectra have roughly the same general shapes. For runs 2, 
3i and 4 the spectra are noticeably different from run 1 
in regards to location of peaks and valleys in the range 
of frequencies from 7 cps to 11 cps. The maxima at 5 cps 



Fig. 16 Power Density Spectra, 3 Levels, Run B 

and 22 cps (the major peaks) remained intact throughout the 
various operations. Little else can be said concerning these 
results other than it must be recalled that all computed points 
are the summation of only 650 sample products. This relatively 
small sample size can account for much of the variability noted 
in the 3“level results. 

In summarizing the results of these experimental studies 
of quantization effects, it is first pointed out that these 
results are based on correlations determined from only 650 
sample pairs--a fairly small sample size. All conclusions are 
made in cognizance of this fact. 

First, correlations obtained with quantization as coarse 
as 7 levels (3 bits) were excellent when compared with both the 
analog results and the 256 -level results. There are no detecta 
ble changes in the frequency information contained in the data 
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as a result of this quantization. A change in bias or scale 
factor of -7% (l /2 level) produces no noticeable or uncomputa 
ble change in the correlations, frequency information again 
being unaffected. The change in mean-square value due to 
quantization is computable and is relatively small fox the 
7-level case. As a whole, the 7-level study supports tbe 
theoretical results rather closely. It is recalled that the 
normalized value of the correlation functions were usually 
considerably less than 0 . 5 . especially in the case of the 
Run B data. 

Second, the quantizations at 4 levels (2 bits) produced 
correlations whose variability although large could possibly 
be acceptable in lieu of the fact that this variability could 
partially, at least, be attributable to the small sample size 
Again frequency information appeared to be unaffeoted by bias 
shifts and saturation effects. 

The results of one-bit quantization were satisfactory 
enough to merit additional study in the form of a thesis 
investigation. A simple real-time correlator is brought into 
the realm of possibility by the encouraging results of these 
studies. It should also be noted that the variability of the 
2 -level quantization results over the 256 -level results was 
less than the variability between the sectional correlograms 
for the first eighth and last eighth of the data! 



CHAPTER III 


STUDY OF BASIC SYSTEM TYPES FOR CORRELATION COMPUTATION 

A. INTRODUCTION 

This section begins with a discussion of the dependence 
of correlator type on the input and desired output information 
The various schemes available for realizing each correlator 
type are discussed as to their advantages and disadvantages. 
The section closes with a rather comprehensive listing of most 
of the currently used techniques (that are applicable) for 
performing the operations of delay and storage, multiplication 
integration, and recording. 

B. SYSTEM BREAKDOWN 

The procedure of obtaining the correlation function of a 
set of data involves three basic steps. The first step con¬ 
sists of transforming the data into a form that the correlator 
can use. If automatic analog or digital computers are to be 
used, the data must be transcribed to the form that each 
computer can interpret and operate upon. The second step 
consists of performing the correlation computation. The third 
and final step is the transformation of the oomputer results 
to a form suitable for interpretation or other use. This form 
may be a plotted curve, a tabular listing, a scope plot, a 
punched tape , etc. 

The choice of a device to perform the actual correla¬ 
tion computation then is seen to depend upon both the form of 
the input data and on the desired form of the output results. 
The form and character of the input data impose the more 
stringent restrictions on the type of correlator than does the 
output requirement. The restrictions in design due to these 
specifications are discussed in detail in the pertinent sec¬ 
tions which follow. 
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C. SYSTEM SPECIFICATION 

For the purposes of disfcussion it will be assumed that thd 
correlator is to be used as an investigative tool for thfl 
analysis of experimental data "i'f'om physical processes* A diffl ' 1 
culty, then, that is encountered is that the investigator often 
does not know what part of the correlation function or what part of 
the power spectrum contains the information he is seeking. He 
is therefore in a sense forced to look at the correlation func¬ 
tion in rather fine detail over a sizable range in time delay. 
This uncertainty and wide variation requires that the corre¬ 
lator be designed such that the spacing between computed values 
and the number of computed t yalues can be varied over wide 
limits. It is not uncommon.for a correlation to oontain 
Upwards of one hundred computed points. The spacing should be 
chosen so that there are at least four computed points per the 
highest frequency to be discerned in the data. Nyquist*s 
sampling theorem requires an absolute minimum Of two points 
per cycle. On this basis the total number of Computed, points 
should be equal to the product of the ratio of the highest 
frequency to lowest frequency of interest and the number of 
points per cycle of the highest frequency. 

To make possible a time scale change, the test data can be 
recorded on magnetic tape. This permits the investigator to 
use more efficiently the correlation computer by allowing him 
to run the data in as fast as the computer can process it* A 
frequency modulation scheme is usually used in the recording 
to enable the low frequencies to be recorded, and to help 
prevent loss of information during subsequent re-recording and 
playback. 

For purposes of discussion, the form desired of the output 
of the correlator is assumed to be a point-by-point plot of the 
correlation function. As will be pointed out later, it may 
also be advantageous if the output is also recorded in a form 
that will easily permit further computation by a general- 
purpose digital computer. Such a form might be a punched paper 
tape or a digital magnetic tape record. 
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With the input and output specifications thus spelled out 
literally, it is desired to determine the correlation computer 
which will perform the single correlation computation as 
rapidly as possible. The design is to have the versatility, 
and flexibility previously mentioned, and must be as simple 
and reliable as possible while retaining a computational accu¬ 
racy commensurate with data length and data statistics as 
outlined in Chapter II. 

D. BASIC SCHEMES FOR PERFORMING THE CORRELATION COMPUTATION 

To the writer's knowledge, there are four principal types 
of correlation computers. The classification is made on the 
basis of the mathematical manner in which the correlation 
coefficient is computed. 

The first type is essentially the straight analog correla¬ 
tion computer. Its operation is as follows. A value of tiiiie 
delay t is chosen and fixed. The data is then continuously 
multiplied by itself shifted in time by t. The continuous 
product is then continuously integrated. After a fixed length 
of time T the computation is stopped, and the correlation 
coefficient value is read as the analog of the final value of 
the integrator. The next point is computed using the same data 
but a different value of t. Descriptions of several successful 
correlators of this type are found in referenoe ; s 1, 6, 7, 9. 10, 

11 , 12 , 13 , 26 . 

The second type of calculation scheme consists of a slight 
modification of the first type. In this system instead of com¬ 
puting the correlation on a point-by-point basis, the value of 
time shift t is slowly and continuously varied. Thus, the 
correlation function is generated continuously. In this scheme 
a very long data length is required. For the correlation to be 
meaningful, the statistics of the data must be reasonably time 
invariant over the long run. As a general rule, this scheme 
has no advantage in time saving and accuracy over Scheme 1 for 
comparable analog components. A correlator of this type is 
discussed in detail in (5). 



The third type of correlation scheme is based on the 
sampling principle* The data is sampled at a rate such that 
the adjacent samples can be assumed to have statistics inde¬ 
pendent of one another* The sampling interval thus chosen is 
then greater than the maximum time shift of interest. The 
correlation coefficient is then built up by summing a fixed 
number of products of the sample of the time function and the 
sample of the time function shifted by t units of time. The 
number of samples required for a fairly stable correlation 
function result has been discussed in Chapter II and is usually 
in excess of several thousand* Thus* this scheme requires a 
record length at least several thousand times the maximum t 
shift. Correlators of this type are discussed in (3) and (8), 
and find their greatest use where the input information is 
located in a high frequency pass band and wheie a very long 
record length is available. 

The fourth type consists of a slight variation of the 
third type, and is aimed toward a more efficient use of the 
record length* In this scheme the data is sampled at intervals 
corresponding to the minimum time shift increment. Independ¬ 
ence of adjacent samples is not assumed or required. Again the 
computation consists simply of a summation of a fixbd number of 
products of samples. This scheme is usually employed when the 

computation is performed on a general-purpose digital computer. 

1 

The record length required by this scheme is nearly ^ times 
that required by the third type where N denotes the number of 
computed points. 

Correlator designs of types two and three require very long 
record lengths and are thus highly dependent on the station- 
arity of the recorded time signals. Correlators of types one 
and four,on the other hand, can be used with relatively short 
record lengths and tend to be much more efficient in the proc¬ 
essing of the available data. The remainder of the discussion 
is confined to correlator designs of type one and type four. 
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E. DISCUSSION OF POSSIBLE SYSTEM DESIGNS AS TO COMPONENTS 

The type-one system is essentially a continuous analog 
computing system whereas the type-four system is basically 
a discrete computing system being most likely digital in form, 
although discrete analog systems are possible. Because the 
basic correlation computation consists of four fundamental 
mathematical operations and because these operations can each 
be accomplished by many components, the possible number of 
correlator designs is very great. The designs may involve 
entirely analog components or all digital components, or may 
be a hybrid type utilizing both analog and digital techniques. 

It is necessary to make a few general comments first 
before discussing the systems and components in detail. It 
is assumed first that the input to the correlator is to be 
data recorded on magnetic tape in frequency modulated form. 
Because of bandwidth limitations in the recording scheme, 
the highest frequency component of the input data is limited 
to 5 kilocycles per second for a 30-ips tape speed. Thus, 
a goal of the correlator design must be a capability of 
processing input data at this maximum rate. For an analog 
system this specification sets the bandwidths required of the 
individual computing components. For a digital system this 
specification partly establishes the minimum sampling and 
computation rate. The other factors which affect the sampling 
rate are the record length and desired minimum spacing between 
computed correlation values. 

Regardless of the sampling rate, any type-four system will 
not be considered satisfactory unless it can perform about on 
an equal basis with the type-one system. Performance is meas¬ 
ured directly in terms of speed and accuracy of computation. 
Considerations such as versatility, reliability, cost, and 
complexity become important in system comparison only after 
approximate equality of performance is established. 
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A-second point to be brought out is that both type-one and: 
type-four correlators compute the values of the correlation 
function at discrete points. Because the input data rate is 
assumed to be limited not by the computation process but by the 
data recording or storage means the time to compute one point 
on the correlation function is about the same for both systems. 
If total computation time is to be reduced by computer design, 
simultaneous computation of several points must be done. This 
is termed multiplexing . One consideration therefore in ohoos- 
ing a design must be based on how simply the single point 
computation method may be multiplexed. The total computation 
time can be reduced using this means by a factor of N where N 
is the number of simultaneously computed points. 

In discussing analog type elements, attention must be paid 
to the problems of accuracy, bandwidth, drift, and dependency 
on tube characteristics. For digital elements there is essen¬ 
tially no drift problem, but attention must be directed now to 
complexity as a function of the bit size of the data numbers 
and to the time required to perform the particular digital 
operations. It should also be recalled that the input data is 
essentially of analog form. The desired output is an analog 
plot and possibly a digital tabulation if spectra are to be 
calculated later. Thus, if digital means are to be used,both 
analog-to-digital and digital-to-analog converters would be 
required. 

As an aid in evaluating and discussing the different 
systems, two data runs typical of the near extremes that a 
correlator for the data discussed in Chapter II might encounter 
are considered. These typical runs are: 


Short Run 


COMPUTER TIME 

.Real Time 100 :1 Speed up 10 :1. Speed up 


Highest frequency 50 cps 

Maximum time shift 1 sec 

Record length 10 sec 

Number of points desired 200 
A 5 ® sec 

Sample rate for 5»000 500 s/sec 

samples min. 


5,000 cps 
0.01 sec 
0.1 sec 
200 

.05 m sec 
50,000 s/sec 


500 ops 
0.1 sec 
1 sec 
200 

•5 m sec 
5,000 s/sec 
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L .ong Run 


COMPUTER TIME 

Real Time 100:1 Speed up 10:1 Speed up 


Highest frequency 

Maximum time shift 

Record length 

Number of points desired 

A 

Sample rate for 5»000 
samples min. 


50 cps 
2 see 
2,000 sec 
400 

5 m sec 
2 -l /2 s/sec 


5 ,000 cps 
.02 sec 
20 sec 
400 

.05 m sec 
25 O s/sec 


500 cps 
. 2 sec 
200 sec 
400 

•5 m sec 
25 s/sec 


The important considerations implied by these runs are: 

(1) For yery short runs the sampling rate may have 
to exceed the reciprocal of the minimum time 
shift At in order to obtain a sufficient number 
of samples. 

( 2 ) If a fixed sampling rate is used, then the 
number of samples will vary directly as the 
run length. This may be by a factor of 

1,000 to 1. 

( 3 ) If the correlation function is computed one 
point at a time, total computation time may 
be as long as 2.2 hrs or as short as 20 see. 


In review, the type-one system evaluates the integral 



(t) 



I 


T 

f 1 (t) f 2 (t + t) dt 


o 


The specific operations that are involved are: 

(1) delay of f^(t) by a fixed time t 

(2) continuous formation of the product of f^(t) 
with the delayed signal f (t + t) 

( 3 ) integration of the continuous product over the 
finite time interval 0 < t < T 

(4) division by T to obtain the value of the 
correlation function tp^g(T) 

Figure 17 illustrates in block-'diagram form this computation 
sequence. 

The type-four system forms the correlation function as 


N 


? 12 m 


1 

N 



f'(t ) f_(t + t) 
in & n 


n=l 
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This computation is based on discrete operations with the 
samples of the two time signals f^(t) and fg(t). The integra¬ 
tion is replaced by a summation over a finite number of sample- 
pair products. Again, Fig. 17 illustrates the block diagram 
of this computation procedure. 



Fig. 17 Correlation Computation Block Diagram 
1. Delay System 

The first operation to be realized in either system is 
that of the delay of the input signal. If the data is assumed 
to be in analog form, then the delay might be accomplished by 
a tapped artificial delay line (l, 7); or by a set displacement 
between two reading heads on the data tape; or by a fixed dis¬ 
placement between the reading heads on a rotating magnetic drum. 

The use of a delay line is restricted to the situation 
where the time delay between adjacent points is fixed. Since 
a maximum of 400 points per correlation is desired, the line 
would necessarily be very long and complex. The maximum delay 
of 0.4 sec would be extremely difficult to obtain. Corrections 
for phase shift and attenuation would have to be included for 
each tap. Thus, the delay line would be most impractical for 
the proposed system. 

The use of two variably displaced reading heads on the 
data tape has been used (10) with moderate sucess. The prob¬ 
lems encountered are those of change in tape dimensions with 
temperature, humidity, and tension and those of mechanical 
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Interference between reading and recording heads. This latter 
problem becomes especially trying if several read heacls are 
Used with a multiplexing scheme. The tape on such a delay 
device is operated in contact with the heads and at speeds from 
60 to 150 ips--the faster speeds giving greater mechanical dis¬ 
tances for identical time delays. The use of a tape delay of 
this design should be considered wtieh thought is given to 
multiplexing. 

The third type of delay unit is the magnetic drum. This 
type is currently in use in the present correlator and is 
thoroughly described in the literature (11, 12, 27). The 
advantages of this type of drum are excellent dimension or 
delay stability and a resolution of better than 3000:1 in the 
head spacing. The drum however is very susceptible to dust and 
dirt as the spacing between head and surface must be held to 
under 0.001". This spacing accuracy requirement makes the 
mechanical design very critical. More will be said of the drum 
in Chapter XV. The drum thus offers a very flexible medium for 
the time delay operation. 

If a digital scheme is to be used, then the data can 
either be stored by the means outlined above and converted to 
digital form on use, or can first be stored in digital form 
after sampling and quantizing. Storage of data by digital 
means has been achieved in high-speed digital computers in a 
large variety of ways(6l). The storage size required is equal 
to the product of the bit size of the numbers and the number 
of numbers to be simultaneously stored. To keep storage at a 
minimum, the number of stored data points can be limited to the 
number of computed points on the correlation curve. As was 
pointed out in'sections C and D of Chapter II, in order to 
obtain a sufficient number of samples for the short runs, the 
time between samples should be equal to the time between com¬ 
puted correlation values. Thus, for a storage of this limited 
type, a mechanism is required either to shift the data from 
storage element to storage element or to sequentially shift the 
computation to the correct memory cells. The first mechanism 



is, in general, much easier to realize. For it a magnetic 
shift register (28, 29, 32) could be used. For a maximum num¬ 
ber of correlation points of 400 and for a data bit size of 
3 bits, as substantiated by tests outlined in Chapter IX, 

Sec. E, a total of 1200 memory elements would be required to 
obtain the greatest delay. Variation in sampling rate is accom 
panied then by variation in the shifting rate of the register. 
With such a device outputs are available simultaneously for 
computation of all the correlation points. No additional heads 
must be added as in the case of the magnetic drum delay system. 
The resolution of this type delay system is equal to the total 
number of computed points--for our example, 400. To achieve a 
resolution equal to that of a typical magnetic drum system 
(about 3000 : 1 ) , a magnetic shift register scheme would require 
9000 elements. This large a memory may be too costly and 
unwieldly from a circuitry point of view. 

A more practical system for obtaining high resolution 
would be to combine a drum delay system with a magnetic shift 
register system. The drum system would be used to obtain the 
fixed set of long delays required. Schemes could be devised 
to insure that the long delays were a fixed integer multiple of 
the shift time increment. 

For applicable magnetic shift register units, the element 
cost, not including any supporting circuitry, is approximately 
#10 per bit. Thus, a 1200-cell memory element would have a 
base cost of approximately #12,000. This figure is considera¬ 
bly greater than the comparable magnetic drum delay system. 

If quantization to two bits is permitted, the cost would still 
be around the #8,000 figure. 

Thus, it is apparent that the magnetic drum delay system 
offers the most versatile type of delay properties and is as 
a whole less expensive to build than a digital storage system 
of equivalent capability. It should be pointed out, however, 
that the design of the drum system becomes increasingly 
involved when the number of read heads is increased as would 
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be required in multiplexing, whereas the multiplexing feature 
is inherent in the magnetic memory without the addition of any 
extra equipment insofar as the memory is concerned. 

Other-type digital memory systems such as relays, ring 
counters, hard tube flip-flops, acoustics delay lines, electro¬ 
static systems, ferroelectric cells and capacitor-diode types 
were investigated but were not considered for this problem 
because of cost, complexity, speed, and other factors. 

2 . Multipliers 

The classification of multipliers logically breaks down 
into two parts: analog and digital. For the purposes of dis¬ 
cussion, the analog multipliers have been further subdivided 
into four groups. The first group consists of the straight 
analog multiplying techniques, such as variable — M> tubes, 
crossed-field schemes, and FM modulation methods. The second 
group comprises those devices which use the quarter-square 
principle. Sampling types, pulse width-height schemes, time 
division, and time-share multipliers constitute the third group 
Miscellaneous methods such as coincidence counting, log-antilog 
circuits, and electrodynamometers are included in the fourth 
group. Digital multipliers are then considered in the second 
pa rt. 

Before listing the detailed performance characteristics 
of the particular multipliers, a summary of the important con¬ 
siderations is given. Because the storage element which 

a ■ 

furnishes inputs to the multiplier has been assumed to have a 
bandwidth of approximately 5 kc for - 1 db, the analog-type 
multiplier must have & bandwidth of twice this frequency, or 
10 kc. 

A second bbhsidbbation whibh somewhat eases the require¬ 
ments on the Wuitijpiibr and leads to a mor§ simple design is 
thb fact thdfc the ittjput signal is usually pdssed through a 
high pass filtbf first to eliminate any very slowly changing 
bias levels which could cause serious error ib the correlation 
determination. Thus * the associated amplified working with 
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the basic multiplier circuitry need not be pure d-c amplifiers. 
This, in general, permits a wider bandwidth to be obtained in 
the amplifier design with a simpler construction. The inputs 
to the multiplier may be both positive and negative. Thus, 
four-quadrant operation of the multiplier is desired. One- 
quadrant operation could be forced if sufficient bias was added 
to each input signal and if the component of the output that is 
proportional to the two inputs was subtracted out. The accu¬ 
racy that oan be realized by such a procedure is less than that 
of a comparable four-quadrant device. 

The general specification as to accuracy is set at - 1 % or 
less. Susceptibility to drift , sensitivity to change in parts 
or environment, number of tubes or transistors required, 
approximate cost, and relative ease in multiplexing are also 
considered. It is pointed out that the multiplier is followed 
by an integrator. Hence, only the time average value of the 
multiplier output need be accurate. Thus, a multiplier output 
with considerable ripple would be tolerable if the ripple had 
zero average value. 

General discussions of the many types of multipliers are 
found in the literature (33. 34, 35. 60). The results of a 
more detailed literature investigation are set forth in Table I 
which follows. 

Multipliers utilizing the log-antilog principle (54, 55. 
56 , 57 ) are not considered suitable to the correlation applica¬ 
tion because they are restricted to one-quadrant operation and 
because an inherent accuracy of less than 5 % is difficult to 
obtain. Electrodynamometer types ( 6 ) are subject to low fre¬ 
quency limitations and to an'inherent low pass filter type 
integrating characteristic and, thus, are not usable for our 
application. Multiplication using the method of coincidences 
(33. 58) is limited primarily to one-quadrant operation. In 
order to obtain an acouracy of 1 $. or less with modulating 
frequencies of the order to 50 kc,at least one minute of record 
data must be processed ( 58 ). At these frequencies the 
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TABLE I 


GROUP 

TYPE 

QUAD¬ 

RANTS 

FREQUENCY RESPONSE 

\CCURACY 
% FULL 
SCALE 

DRIFT 

SENSITIVITY TO 

PART REPLACEMENT 

NUMBER OF 

TUBES 

MULTIPLEXING PROBLEMS 

REFERENCE 

NUMBERS 

A— 1 

FM-AM DOUBLE MODULATION 

4 

15 KC- 15° 

1% 

DEPENDS ON DISCRIMINATOR 
PARAMETERS 

DEPENDS ON DIODE 

BALANCE 

24 

10 TUBES FOR EACH ADDITIONAL 
MULTIPLICAND 

36 

FM-AM DOUBLE MODULATION 

4 

10 KC - 7° 

2% 

MUST BE ADJUSTED 

EVERY 2 HOURS 

DEPENDS ON DIODE 

BALANCE 

9 

3 TUBES AND 4 TRANSFORMERS 

FOR EACH ADDITIONAL MULTIPLICAND 

37 

DOUBLE AMPLITUDE MODULATION 

4 

30 KC 

0.5% 

0.15% FULL SCALE 

NO DETAILS 

20 

7 TUBES PER MULTIPLICAND 

38 

CROSSED FIELDS-PHOTOCELL 

4 

5 KC 

2% 

0.1% FULL SCALE PER HOUR 
(PRIMARILY IN PHOTOCELL AND 
OPERATIONS AMPLIFIER) 

CHANGES IN PHOTOCELL 
CHARACTERISTICS 

10 

PLUS A CATHODE RAY TUBE 

NO GAIN 

40 

ELECTRON BEAM TUBE 

4 

70 KC- -3DB 

2% 

— 


— 

REQUIRES A SPECIAL TUBE 

FOR EACH PRODUCT 

41 

A-2 

SQUARE LAW VACUUM TUBE 

4 

10 KC 

2% 

SLIGHT 

CRITICAL MATCH OF 6B8'S 

4- 6B8 

2 OTHERS 

NO GAIN 

10, II, 

12 

SQUARE LAW VACUUM TUBE 

4 

15 CPS TO 800 KC± 1 DB 

2% 

2.5% OVER 165 MINUTES 

— 

8- 6AC7 

4 — 6AS6 

NO GAIN 

5 

DIODE NETWORK 

4 

10 KC (DEPENDS ON BANDWDH 
OF OPE RAT'L AMPLIFIER) 

1% 

DUE TO DRIFT IN THE 

OPERATIONAL AMPLIFIER 

DEPENDS ON DIODE 
CHARACTERISTICS 

4 OPERATIONAL AMPLIFIERS 
2 2 DIODES 

NO GAIN 

42 

BEAM DEFLECTION SQUARE LAW 

4 

LIMITED BY OPERATIONAL 
AMPLIFIERS 

1% 

DUE TO DRIFT IN THE 

OPERATIONAL AMPLIFIERS 

DEPENDS ON TUBE 
CHARACTERISTICS 

3 OPERATIONAL AMPLIFIERS 
2 SQUARE-LAW TUBES 

NO GAIN 

44 

DIODE NETWORK PLUS 

OPERATIONAL AMPLIFIERS 

4 

100 CPS FOR 

1° PHASE SHIFT 

0.1% 

VERY LOW 

EASY TO CALIBRATE 

3 OPERATIONAL AMPLIFIERS 
2 SQUARE-LAW NETWORKS 

NO GAIN 

45 

PADDED THYRITE PLUS 

OPERATIONAL AMPLIFIERS 

4 

LIMITED BY 

OPERATIONAL AMPLIFIERS 

2% 


TEMPERATURE SENSITIVE 

3 OPERATIONAL AMPLIFIERS 
2 THYRITE NETWORKS 

NO GAIN 

43 

A-3 

TIME DIVISION 

4 

1 KC MAX 

20 KC REPETITION RATE 

1% 


SWITCH CHARACTERISTICS 
SENSITIVE TO TUBE CHANGES 

3 OPERATIONAL AMPLIFIERS 
6 TUBES 

3 TUBES PER PRODUCT 

46 

TIME DIVISION PLUS 

PRECISION ELECTRONIC SWITCH 

4 

2 CPS (DUE TO HEAVY FILTRG) 
2 KC CARRIER 

0.1 % 

DUE TO DRIFT IN THE 

OPERATIONAL AMPLIFIERS 

STABILITY OF SWITCH AND 
ASSOCIATED RESISTORS 

2 OPERATIONAL AMPLIFIERS 
PLUS SWITCHES 

ABOUT '/ 3 OF BASIC CIRCUITRY MUST 

BE REPEATED PER PRODUCT 

48 

SWEEP COMPARISON PLUS 

TIME SHARE 

1 

1 KC 

0.2% 


CRITICAL IN COMPARATOR 

15 TUBES 


50 



SWEEP COMPARISON 

1 

200 CPS 

!% 


CRITICAL MATCHING OF 

DIODES IN COMPARATOR 

15 TUBES 


51 



DISPLACED TRIANGULAR WAVE 

4 

100 CPS 

(1 KC REPETITION RATE) 

2% 

— 

TRANSISTOR SWITCHING 
CHARACTERISTICS 

SHOULD BE MATCHED 

4 TRANSISTORS 

4 DIODES 

PLUS WAVE GENERATOR 

NO GAIN-LOW INPUT IMPEDANCE 

52 

DISPLACED WAVE USING 

TRANSISTORS AND CORES 

4 

400 CPS TIMING WAVE 

5% 

i 

DUE TO TEMPERATURE CHANGES 

CORES AND TRANSISTORS 

MUST BE MATCHED 

8 DIODES 

4 TRANSISTORS 

2 CORES 

SOME SAVING CAN BE OBTAINED 

53 

DISPLACED WAVE TIME DIVISION 

USING TRANSISTORS 

2 

1 KC REPETITION RATE 

0.5% 

DUE TO TEMPERATURE CHANGES OF 

TRANSISTORS AND POWER SUPPLIES 


1 TUBE 

2 TRANSISTORS 

1 OPERATIONAL AMPLIFIER 

VERY SIMPLE 

49 
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bandwidth of the device* wdlald be of the order of 1 kc» 
Considering the amount of circuitry required, it is felt that 
this method does not hold much promise for our application. 

In comparing the different analog multipliers to the 
specificatiohs of our problem, it is seen that the multipliers 
of Group 1 , although having wide bandwidth performance, are all 
more complex and, henoe, more expensive to construct. The 
drift of the devices are very dependent on the tube character¬ 
istics. The scheme which shows the most proniise is that 
described in (37) where it appears that accuracy and drift have 
been sacrificed at the expense of simplicity. Such schemes as 
(36, 37. 38) do show savings in complexity when multiplexed* 

Multiplier schemes, Group 2, using the quarter-square 
principle can be built with sufficient bandwidth and accuracy 
and with sufficient simplicity to meet the specifications. 
However, this type is subject to both drift and variation due 
to changes in component characteristics. Multipliers of this 
group offer no advantages in simplicity when multiplexed. To 
perform ten multiplications, ten individual multipliers are 
necessary, requiring a total of ten times as many parts. 

The multipliers listed in Group 3. those employing pulse 
width and amplitude modulation, show the most promise when 
multiplexing is considered. Accuracies in the order of 2$ or 
less can be achieved with a relatively simple design. The per¬ 
formance of this type multiplier becomes dependent on component 
characteristics only when accuracy much greater than 1 % is 
required. The output of the multiplier is in general a rectan¬ 
gle wave whose mean value is proportional to the product of the 
two input signals. Since the multiplier is to be followed by 
an integrator, the output wave need not be filtered first. The 
time division multipliers described in the literature (46, 48, 
4^)) were followed by filters to reduce ripple, hence the reason 
for the low bandwidth specification as is shown in Table I* 

This type multiplier is widely used in commercial analog com¬ 
puters (60). Commercial designs are available which could be 
adapted for correlator use with a minimum amount of rebuilding. 
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Summarily, the time-division type analog multiplier holds 
the most promise for a multiplexed computation scheme. If no 
multiplexing is to be utilized, then the choice is between the 
quarter-square multiplier (12) and the application of a modi¬ 
fied commercial time division multiplier. 

The second part of this section concerns the use of 
digital schemes for performing the multiplication of the quan¬ 
tized data. The two general types of multiplication schemes 
are the direct multiplier and the stored multiplication table. 
In the first scheme, the multiplication is carried out in much 
the same fashion as one normally does it by hand except that 
the binary number system is used. The operations are simply 
those of alternately shifting and adding. The pair of opera¬ 
tions must be repeated as many times as there are binary digits 
of the representative multiplier. It is this type of scheme 
(or some modification thereof) that is utilized in the general- 
purpose computers. 

The size and complexity of the shift and add-type 
multiplier design depends on the bit size of the numbers, the 
speed at which the operations are to be performed, and the 
nature of the input and desired output information. It shall 
be assumed that for the correlator design* the input,information 
is in the form of 3~bit numbers temporarily stored in a core 
memory, and that the computation rate is to be 20,000 products 
per second as an upper limit. This requires that the entire 
multiplication operation takes place in a period of 50 M> sec 
minimum. 

A survey of general-purpose machines now in operation (6l) 
shows that this figure of 50 p, sec is reached by only the 
faster and more elaborate machines. It is noted also that 
these machine times are for multiplication of numbers usually 
in excess of 12 bits in length. As an example of a more recent 
development, a group at Lincoln Laboratory has built a trans¬ 
istor multiplier capable of handling 8-bit numbers. For their’ 
design about 660 transistors are required to obtain a 11 |i sec 
operating time. If the complexity of their circuit is reduced 
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to around 400 transistors , the computation time lengthens ,to 
about 25 M< sec. By scaling down this type multiplier to handle 
only 3-bit numbers, the complexity could probably be reduced to 
about 200 transistors for a computing time of 20 to JO M- see* 

In scaling down a design only the number of flip-flops in the 
multiplier decreases. The circuits whioh control the sequence 
of operations performed during the multiplication are not 
altered as the bit size of the numbers is decreased. 

The estimate given above is felt to be fairly representa¬ 
tive of multipliers using flip-flops of either transistor or 
vacuum tube composition. It is possible to perform the opera¬ 
tions with magnetic core elements serving as the flip-flops* 
Unless great engineering effort is expended toward an optimum 
digital multiplier for the 3-hit task, the choice between 
transistors, tubes, and cores appears to be on an even basis 
and, hence, could be motivated by other considerations in the 
system design. 

Unless more elaborate and necessarily more complex 
techniques are used, the average multiplication time for the 
shift and add-type multiplier will lie in the range of 20-40 
sec. Thus, if a multiplexing scheme is to be used, then it 
becomes obvious that the digital multiplier cannot be time 
shared between channels but that a separate multiplier must be 
provided for each channel. 

If the multiplier was fast enough to be time shared, 
circuitry would have to be added both to switch sequentially 
the inputs and outputs of the multiplier and to provide a means 
of restoring the data information back in the core memory after 
it had been read out as an input. The circuits needed to 
restore this information, although reasonably simple, require 
upwards of 12 |A sec to complete the operation. Thus, the 
modest read out and restore times also tend to limit the extent 
to which time-sharing can be used. It is hardly conceivable 
that with current methods one could use a single multiplier to 
perform more than three or four multiplications during the 
50 u sec minimum interval. 



The second type of multiplier consists of a programmed 
multiplication table in matrix form. Description of matrices 
used for multiplying and switching applications are discussed 
briefly in ( 32 ). Briefly the matrix consists of a number of 
input lines equal to twice the total number of bits in both 
input numbers and a number of output lines equal to the total 
number of different products. A decoder is required to oonvert 
the output line information back into binary form for transfer 
to the accumulators. The matrix multiplier is the most rapid 
type of digital multiplier. Multiplication time can be below 
1 |i sec with little difficulty. 

In order to get an idea of how complex the matrix 
multiplier is, designs for both 2 - and 3 ~bit multipliers have 
been worked out. The matrix and decoder for the 2-bit multi¬ 
plier are shown in Fig. 18. For a complete matrix multiplier, 
the maximum number of elements necessary are given in Table II. 
The number of diodes shown in the table could possibly be 
reduced by improved design to a slightly smaller figure. How¬ 
ever, it is felt that the figures given are fairly representa¬ 
tive of actual design. 


Table II 


No. 

of 

Bits 

Diodes 

Flip- 

Flops 

No. of 
Lines to 
Switch 

in Matrix 

Decoder 

Total 

1 

2 

0 

2 

3 

3 

2 

42 

9 

51 

8 

8 

3 

337 

57 

394 

12 

12 

4 

2032 

269 

2301 

16 

16 


The matrix multiplier has the definite advantage of not 
requiring very much in the way of control circuitry. Since 
multiplication speeds are so fast, such a multiplier could 
easily be time shared. The number of lines to be switched per 
product to perform this time sharing is shown in the last 
column in Table II. If, for the moment, the switching problem 
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is neglected, it can be seen that the cost of a matrix multi¬ 
plier for very small numbers is much less than that of a com¬ 
parable shift and add type multiplier. 



x y 

INPUTS 

Fig. 18 Two Bit Multiplier 

From’ the previous discussion*, it can be concluded that the 
2-bit matrix multiplier will, in general,, be less expensive and 
faster than the shift and add type multiplier. In the 3-bit 
c&s&r the* diode matrix type appears to be somewhat simpler to 
bbnstruct and possibly less expensive thaiv the shift and add 
typ&h For number sizes greater than 3 bits',, the mdtrix and 
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decoder become extremely complex and costly, and thus 
impractical. From the multiplexing standpoint, it is felt that 
for both the 2-bit oase and the 3-bit case it would be simpler 
to build multiple matrices and decoders than to devise a time¬ 
sharing system. As mentioned before, if a time-sharing scheme 
is used in conjunction with a magnetic shift register storage, 
then circuitry must be provided to write the information back 
into storage after it has been read out, since read-out at any 
time other than during the shift pulse destroys the information 
in the core. 

For interest a hybrid type of matrix multiplier is shown 
in Fig. 19. The multiplier accepts as its inputs the data in 
digital form from the shift register storage elements. The 
resistors on the right side are so chosen that the product 
lines carry a voltage proportional to the product when the line 
is not grounded. Thus, the voltage across.the resistor will 
have a magnitude proportional to the product of the digital 
inputs. With a simple switching circuit, the output voltage 
can be shaped into a rectangular pulse of constant width. 

Hence, the area of the output pulse (its average value) would 
constitute the desired product in analog form. This scheme has 
the advantages that it is somewhat simpler than the pure matrix 
type and that the output is directly in analog form. For the 

2 - bit case, the design is straightforward; whereas for the 

3- bit case, the design is somewhat more complicated by the 
larger number of diodes needed. The finite value® of the 
forward, and especially the back, resistance of the diodes must 
be taken into account. 

3 . Integ rators and Accumulators 

If an analog system is being used, then the operation of 
continuous integration with respect to time of the correlation 
product is to be carried out. This operation is most easily 
realized by the widely used feedback integrator. Some of the 
existing correlators using this scheme are (4, 8 , 10 , 11 , 12 ). 
In present-day analog computers all time integrators are of 
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this form (45, 60). As a result, their design has been 
developed to a fine degree. Various schemes have been utilized 
to reduce drift and to extend the usable bandwidth. Two 


+ I0E 
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Fig. 19 Digital-Analog Multiplier 

particular discussions of these schemes are contained in 
(64, 65 )• Drift can be kept below 100 mv per hour and the 
open loop gain crossover frequency extended to more than 10 kc. 

It is obvious that if multiplexing schemes are to be 
utilized, one integrator or accumulator must be available for 
each simultaneously computed point. There is nothing to be 
gained in design simplicity by multiplexing. Five points 
slnipi^ Require five separate integrator units. 
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Low-pass filters are not considered practical as averaging 
or integrating devices because of the extreme variability of 
data frequencies and length. Filters become practical only 
when the integrating time is reasonably small, say less than 
several seconds. 

If a digital multiplier is used whose output is a binary 
number, then an accumulator or summing register is required to 
perform the integration (summation). Such devices have been 
constructed in a variety of forms and are the basic computing 
blocks in the large general-purpose machines. The accumulator 
circuitry involves both the simple logic elements and the neces 
sary control elements. These elements can be built using 
transistors, tubes, and/or magnetic cores. 

The important design factors for the accumulator are the 
total register capacity and the operating speed. The operating 
speed of 20,000 operations per second imposes no serious limita 
tions in the design. The register capacity is a function of 
both the bit size of the product and the total number of 
samples to be summed. For the purposes of estimation, the 
total number of samples is assumed not to exceed 50 *000. 

Two possible types of accumulators are envisioned. The 
first is a simple adder into which all numbers are positive. 

The second type is a reversible binary adder where the input 
numbers may be either positive or negative. The second type 
then may either count up or down, depending on the sign of the 
product input. In general, the maximum count for the reversi¬ 
ble counter will be less than that for the simple adder. 

Table III relates bit size , sample size and register length for 
each of the two types of accumulator. The assumptions made in 
the preparation of this table are that the amplitude of the 
data is Gaussian distributed and that the quantization range 
is extended over five times the rms value of the data. For a 
Gaussian distribution 98*7$ of the points will fall within this 


range. 
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Thus, from the standpoint of register size there seems* to 
be little difference between the two types--a difference of 
approximately 3 bits in length. As far as accumulator design 


Table III 


Required Register Capacity (Bits) 

Bit Size 

Samples 

Mean 

Simple Adder 

jReversible Binary 

2 

5,000 

zero 

14 

11 


‘0 

1 + 25% 

15 

12 

! 2 

50,000 

1 < 

zero 

18 

15 



+ 25% 

18 

15 

3 

5,000 

zero 

17 

14 



+ 25% 

17 

15 

3 

50 ,000 

zero 

20 

17 



+ 25% 

20 

18 


goes, this difference is insignificant. Likewise, changing 
the number size from 2 bits to 3 bits raises the accumulator 
size by 3 bits in each case. 

The design of the accumulator is somewhat simplified by 
the fact that the input number size is limited to either a 
4- oi* 6 -bit number corresponding to quantization to 2 or 3 
bits. This means the accumulator action need be only 4 or 6 
bits long with the remaining summing action performed by a 
simple binary oounter counting the carries from the short 
accumulator. Such a counter need not be fast acting since 
carrlefe oan occur as fast as 20 ,'000 times per second as an 
absolute maximum. The counter requirements become much less 
severe as one proceeds down the counter. 

This scheme is most simply accomplished if all input 
numbers 'dre positive. If some! numbers are negative, then the 
design -of both the counter arid accumulator necessarily become 
more complex. For all input numbers positive, the length of 
the acodmulator can be changed to accommodate a greater number 
of samples 1 simply by adding more elements to the counter chain. 
Ihe only control circuitry required is a reset at the end of 
the add cycle. 
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To obtain some idea of the complexity of an accumulator, 
reference { 66 ) was used as a basis for estimation. Per bit or 
order of an accumulator, the logic elements required are 
2 flip-flops, 3 AND circuits, 2 OR circuits, and a delay ele¬ 
ment. Such logic elements if realized by either vacuum tubes 
or transistors would comprise about 8 tube sectiops and 
4 diodes. The counter is nothing more than a K chain of flip- 
flops in oascade. 

It is reasonable to conclude that the oost of a digits 

A 

accumulator would be perhaps several times that of an analog 
integrator having comparable performance. The digital accumu¬ 
lator has the advantages that it is free of such ailments as 
drift; that it is in general a more reliable element whose 
output characteristics are practically independent of its 
internal element characteristics; and that the output being in 
digital form is directly available for recording on a punched 
tape. 

4. Division 

In computing the correlation coefficients, the integral 
of the product must be divided by the length of the integration 
time in the continuous case, or by the number of samples in the 
discrete or digital case. Since primarily the relative shape 
of correlation function is of interest, it is sufficient to 
obtain the correlation within a constant of proportionality. 
Thus, in the analog case only the length of integration time 
must be held fixed for all calculated correlation points. This 
can be accomplished by incorporating special signals on the 
data tapes signifying the start and completion of computation. 

For the digital system a counter must be incorporated to 
stop the computation after a fixed number of samples have been 
operated upon. A 16-bit counter would enable a count up to 
65.535* By constructing an AND circuit from the different 
parts of the counter, the computer could be set to stop on any 
number of samples up to this number. 
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5. Output Equipment 

For many purposes, the desired form of the output 
information is a graphical plot capable of being reproduced. 

As was pointed out in Chapter II, it is also extremely advan¬ 
tageous in many cases to have the output information recorded 
in such a form that further operations on the computed results 
such as spectra computations can be accomplished with a minimum 
of expense and effort. Since in all likelihood these subse¬ 
quent computations would be carried out on a general-purpose 
digital machine, the recording medium should be one that the 
particular computer oan accept as an input. For purposes of 
illustration, the following discussion concerns the input 
requirements for general-purpose digital computers, such as the 
IBM 704. For correlators connected directly to special-purpose 
computers, many of these data handling problems would not be 
present. 

Figures 20 and 21 show the block diagrams of the output 
equipment for correlators of both the digital and analog 
varieties. The two systems are almost identical except for the 
location and type of the converter and the construction of the 
switch and timer control. The construction of the swtich and 
storage element and the converter depend upon the operating 
characteristics of the graphical recorder and the punch. 

Figure 20 assumes that the punch is operated from computed 
data already in digital form--resulting from a digital computa¬ 
tion. If, however, the correlation is accomplished by an 
analog correlator as in Fig. 21, then an analog-to-digital 
converter must be provided to code the data into an acceptable 
form for punching. The subject of analog-to-digital conversion 
is discussed at length in (32). The requirements on the con¬ 
verter are very broad. First , it must convert at a rate that 
exceeds the speed of the tape punch in accounting for the 
multiple-character representation of the data numbers. For a 
four-character representation, conversion must be at a rate 
exceeding two per second. Since conversions at rates up to 
50 kc are rather simply achievable, conversion rate is not a 
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Fig. 20 Output Equipment for Digital Computation 



Fig. 21 Output Equipment for Analog Computation 
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problem. The other requirement on the conversion device is 
that it be able to convert the analog information to at most 
a 10-bit binary quantity, or one part in 1024. As far as the 
eye is concerned, a plotting accuracy of about 0.5% should be 
sufficient, which corresponds to an 8-bit representation. 

In choosing an analog-to-digital converter, it is possible 
to use to advantage the fact that the voltage being quantized 
appears as the output voltage of the integrator. A possible 
scheme is shown in Fig. 22. At the end of the correlation compu 
tation, the voltage at the output of the integrator is propor¬ 
tional to the correlation coefficient. To quantize this voltage 



Fig. 22 Analog-Digital Converter 

a fixed voltage Eg is applied to the input to the integrator at 
the same instant a gate is opened to permit pulses from the pulse 
source to enter the binary counter. The fixed input voltage will 
be integrated by the integrator, and the result subtracted from 
the output of the integrator until the net output voltage of the 
integrator is equal to the fixed negative value -E^. At this time 
the coincidence circuit will close the gate, thus stopping the 
pulse train. The count in the binary counter is then the desired 
digital representation of the integrator output. The integrator 
is then reset ho have zero output before the next computation 
is to proceed by using the integrator as the high-quality 
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linear sweep generator, both the sweep generator and sampler 
are eliminated from conventional converter circuitry. The oon* 
verter would then require only a pulse source, coincidence 
circuit, gate, and a binary oounter of 10-bit length. 

The second type of data display often required is a repro¬ 
ducible graphical plot of the computed correlation points. If 
an analog system is used, the recorder can be driven directly 
from the output of the integrators. If a digital computing 
scheme is used, then a digital-to-analog converter must be 
added to drive the recorder. This converter need only convert 
the last 8 bits of the accumulator count to an analog voltage 
because it is difficult to tell finer differences by eye, and 
also because recorders are seldom more accurate than -1$. Con¬ 
verters or decoders using multiple sources and weighted resis¬ 
tors are discussed at length in (3^)* Again the requirement 
on 'the operating speed of the converter is very loose; the 
conversion rate must be greater than two per second. 

If a recorder is to be used, the following characteristics 
are important. For ease of readability the chart scale should 
be linear and rectangular. The paper should be transparent to 
make for easy reproduction. An ink line on the chart and a 
tero center pen motion are desirable. If a single correlation 
point is computed for each'pass of the data, a constant speed 
drive on the recorder chart appears to be the most simple 
solution. 

If the system is ipultiplexed, the recording problem 
becomes much more complicated. It is then necessary to record 
not one but several points successively for each pass of the 
data tape. For the purpose of discussion, assume that there 

are five simultaneous analog correlations' being obtained. To 

- ‘ '( . 

minimize the complexity of the switching and storage unit as 
shown in Figs. 20 and 21, the accumulator or integrator values 
should be recorded as quickly as possible. The most reasonable 
scheme appears to be one employing a stepping or ratchet drive 
on the chart or strip recorder. Since the correlation is com¬ 
puted at discrete, evenly spaced values of time shift, there 
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would be no sacrifice in versatility by using the stepping 
drive. In fact, the stepping drive should be simpler and 
cheaper to construct than the stable constant speed drive 
contained in many strip recorders. 

The advantages of a stepping chart drive are positive 
spacing between recorded points regardless of variations in 
pulse group spacing and simplicity of drive. Problems that 
are introduced by this scheme are those of stylus drag errors 
due to a static chart during recording and false indications 
given by stylus overshoot. The first problem becomes negligi¬ 
ble if the galvanometer torque constant is sufficiently great. 
The overshoot problem can be eliminated simply by introducing 
enough series resistances to make dynamics critically damped. 

A possible sequence of operations using a stepping chart 
recorder is: 

(1) record output of Integrator No. 1 

(2) return stylus to zero position 

(3) advance chart one step 

(4) repeat sequences 1, 2, 3 for 
integrators 2 through 5 

By returning the stylus to the zero position after each 
recorded point , a constant check on drift in the recorder drive 
amplifier is made. Use of a high-performance galvanometer can 
result in an operating time of approximately 0.5 seconds or 
less for each recorded point. Thus, a group of five points 
could be recorded in under three seconds. Keeping this total 
recording time to such a low figure makes it possible to elimi¬ 
nate any temporary storage of the computed data. 

The remaining problem in the output equipment is that of 
performing the necessary switching functions for the plotting 
and punching of the output data. The switching required for 
the digital case , as shown in Fig. 20, is by far the more com¬ 
plex than for the analog case of Fig. 21. The switching 
schemes available for the digital case are the matrix plus gate 
tubes, beam switching tubes, and the mechanical commutating 
switch. For five accumulators of 10-bit capacity each, a total 
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of 50 lines must be gated at the proper times to the correct 
locations. If a matrix and gate tubes are used, upwards of 
20 tubes and 100 diodes would be required. Ten beam switching 
tubes oould do the same task. A mechanical commutating switch 
%3 feasible because the switching rates are rather low--about 
twice per second. If a stepping drive is used on the strip 

I 

recorder, a commutating switch could, possibly be driven from 
the same drive. For the analog case a commutating switch seems 
to be the most practical switching scheme. 



CHAPTER IV 


RECOMMENDATIONS FOR A CORRELATOR DESIGN 
A. GENERAL RESULTS 

If the data being correlated have frequency components 
that extend over a vety 1 ‘ broad range , much time oan be saved 
if two modified correlations are taken instead of one single 
correlation with a sufficiently large number of points to 
resolve the highest and lowest frequencies. The first corre¬ 
lation is obtained on the data after it has been passed through 
a low-pass filter; the second correlation is obtained on the 
data after it has been passed through a high-pass filter which 
is the complement Of the low-pass filter. (See Appendix.) The 
data after being passed through the low-pass filter oan be re¬ 
recorded with an additional speed up in order to utilize more 
effectively the tape and computer capabilities. The complete 
correlation function of the original data is then found by 
simply adding together the two correlations on the modified 
data. 

It is well to mention again that the information contained 
in the correlation function is only a small part of the total 
information carried in the stochastic signals being investi¬ 
gated. Actually, correlations' of all higher orders are 
required to ooifapletely characterize statistically the sto¬ 
chastic signal. No'results more striking than the results of 
the one-.and two-bit correlations are needed to help emphasize 
this point. Thus, a very precisely determined correlation 
function may reveal little more information than one obtained 
by less sophisticated means. The effective and efficient use 
of the correlator therefore resides in the intelligence and 
finesse of the investigator. 

The most encouraging results of quantization studies 
prompted a detailed investigation into the design and construc¬ 
tion of digital correlators that would meet the requirements 
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of the particular correlation problem. The conclusion arrived 
at is that the digital correlator offers a practical solution 
to the problem when it is desired to compute several points 
simultaneously. The two-bit correlator compares in cost and is 
more reliable than its equivalent analog machine. For the sin¬ 
gle point correlation the analog machine appears to be the best 
answer. The actual construction of a digital correlator would 
require a rather large amount of engineering time if a reliable 
and efficient design is to be used. The hardware cost and com¬ 
plexity could be reduced somewhat from the "brute force" design 
through the ingenuity and application of the broad experience 
of a digital systems designer. The reliability of a digital 
correlator would be superior to that of its analog counterpart 
pt least as far as the digital elements are concerned. This is 
based on the experience of:the,operation of large general- 
purpose machines, such as Whirlwind, where reliability is 
extremely high. The advantages, disadvantages, and problems 
associated with a digital design are brought out in a subse¬ 
quent section in this chapter where a possible digital design 
is considered in some detail. Xn both the analog and digital 
designs, the construction of a digital output mechanism is con¬ 
sidered. This output would be used to feed a general-purpose 
digital computer for performing the spectral computation. 

B. AN ANALOG CORRELATOR 

As was pointed out in Chapter III, a correlator of the 
analog type represents the most efficient type correlator from 
the standpoint of processing data obtained from a bandwidth 
limited , source. The discussion in this section therefore is 
restricted to the description of a possible analog correlator 
capable of computing several points simultaneously. 

As a proposed design the use of a continuous data tape 
loop and a multiplexing scheme are suggested. The block dia¬ 
gram of such a system is shown in Fig. 23« The operation and 
design considerations of this system are now considered in 
detail. 
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A oontinuous tape loop is used both as a mechanism for 
storing the input data and for providing for relatively long 
time shifts in the correlation. The tape loop speed is chosen 
on the basis of input data rate, of length of tape loop, and 
of the effect on mechanical dimensions. High tape rates give 
the possibility of high computation rates. If the usable band¬ 
width of the tape record playback system is utilized, then the 
langth of tape and hence mechanical dimensions of the tape loop 
device will be fixed. 

The limiting factor in determining tape loop speed then 
resides not in the tape loop design but in the performance of 
the associated equipment in the correlation computer. For the 
analog system these factors are the magnetic drum delay band¬ 
width, multiplier bandwidth, and the required plotting and 
resetting time interval of the correlator. For a magnetic drum 
of the type used in (12), the upper limit is about 50 kc which 
is adequate for an FM system running at 30 ips but not suffi¬ 
cient for an FM system operating with a 60-ips tape speed. 
Quarter-square multipliers can be built with bandwidths in the 
tens to hundreds kc bandwidth. Time-division multipliers are 
rather difficult to construct to handle frequencies above 10 kc. 
For the purpose of discussion, it shall be assumed that the 
total time required for plotting the data and resetting the 
computing elements will not exceed three seconds. Thus, for a 
30 -ips tape speed, 9 ° inches of tape length are required between 
the end and beginning of the data on the loop; for a 60 ~ips tape 
speed, 180 inches, or 15 feet, of tape is required. 

Before making a decision as to the tape speed for the loop, 
a calculation of data tape length should be made. If the typi¬ 
cal "long" and "short" runs are used, then one finds tape 
lengths (for data only) of 600 inches and 3 inches, respectively. 
The long run has a ratio of data length to maximum time shift of 
1000:l--a figure considered excessive for a single run. If this 
ratio is limited to 200:1, then a tape length of 120 inches is 
required which is a quite feasible figure. If extremely long 
records are to be correlated, then it is suggested that the 
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record be broken down into shorter sections which a tape loop 
could handle. This point will be returned to shortly. Thus, 
it is noted that for tape speeds of 30 ips or 60 ips, as much 
time is required to plot computed results and reset the system 
as is required to perform the computation. This suggests that 
a tape speed of 30 ips and a tape loop length of 120 inches be 
chosen} the computation can be ^dccomplished as the data tape 
completes one circuit and the readout of computed information 
performed during a second pass of the data, thus conserving 
tape length. 

The control for the "compute" and "readout" cycles could 
be accomplished from a recorded signal on a third channel of 
the tape loop. A tape loop of this type is shown in Fig. 23 . 

If much longer record lengths are to be processed, a scheme 
such as is shown in Fig. 24 could be used. Methods of this 
type are utilized in the tape storage elements of several large 
general-purpose digital computers. Tape transports with con¬ 
tinuous tape loops are now commercially available. 

The use of a tape loop gives several major advantages: 
no rewind time is required; the tape drive design nefed not be 
compromised for fast start-stop operation; and by adding sever¬ 
al read heads, the tape loop may be used to obtain delays 
longer than those obtainable from ttie magnetic drum. The tape 
drive consists simply of a powered capstan and a tension con¬ 
trol r It can be designed for single-speed operation or for 
two-speed operation if the loop is to be used to gain an addi¬ 
tional time scale speed up. Two-speed operation permits much 
more versatility in the recording and playback speed ups. For 
example, if the basic tape transport can operate at 0*3 ips, 

3 ips, and 30 ips and the tape loop can operate at 10 ips and 
36 ips, then data speed-ups of 1:3, 1:1, 10:3, 10:1, 100:3, 
eirid 100:1 are possible* The tape used for the tape loop should 
be chosen to have good dimensional stability in the presence 0t 
variations in tensidn, -temperature , and humidity. 
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The next element to be considered is the magnetic drum 
storage. The drum used in (12) was built after a very satis¬ 
factory design by Goff (ll). If multiplexing is to be employed, 
the mechanical design of the record and playback head parrier 
becomes rather complex and involved. If it is assumed that 
five simultaneous delays of different values are required, one 
has a choice of several different schemes of head spacing as 
represented by the time shifts shown in Fig. 25 . From the 
standpoint of mechanical interference , the first scheme is the 
easier one to realize because only one carrier need be used. 
From the standpoint of the plotting and read-out problem, the 
second scheme is by far the simpler one. To perform the plot 
of data computed as in the first scheme would require either 
the ohart to exhibit large excursions very rapidly in both the 
forward and reverse directions, or the use of several 
recorders--one for each set of delays. Such a scheme thus 
appears impractical. 

A mechanical design to implement the second method 
requires a separate head carrier for each separate delay 
desired. Figure 26 shows one crude design that would have the 
flexibility required. Rotation of the control Shaft 0 2 adjusts 
the initial stagger spacing of the heads; rotation of shaft 0^ 
advances all heads together. Mechanically, the problem is dif¬ 
ficult because the spacing between the heads and the drum must 
be kept below 0.001 inches and above the contact point. Such 
spacing will be difficult to achieve for the several head 
oarriers moving simultaneously. The key to the design of a 
satisfactory analog correlator rests in the Solution of this 
mechanical problem. 

The application of the multiplexing scheme requires that 
each computation ohannel have its own playback amplifier and 
demodulator, multiplier, and integrator. The demodulator would 
be of a standard design to recover the signal from the recorded 
frequency modulated signal. For a multiplexed system a 
multiplier utilizing the time division principle is preferred 
because of the possible saving of components through 
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Fig. 24 Tape Loop for Long Tapes 



Fig. 25 Data Spacing Schemes 
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multiplexing and because of its relative insensitiveness to 
component characteristics. The integrator would be a simple 
feedback type integrator as previously described. 





HEAD POSITION 

Fig. 26 Drum Head Control 


A problem that arises with the application of multiplexing 
is that of calibration and drift in components. With the 
single-point correlator the exact calibration factor need not 
be known as long as it remains constant over the entire run. 

In the multiplexed system, each channel has its own demodulator 
and multiplier; and extreme care must be taken to ensure that 
each channel has identical operating characteristics. The pro¬ 
cedure of calibration will then be much more critical and, 
unless automatic balancing schemes are used, will require 
correspondingly longer setup time. This fact is a disadvantage 
for the analog system. 
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C. AN ANALOG-DIGITAL CORRELATOR 


The hybrid design proposed to overcome the difficulties 
mentioned previously is shown in Fig. 27. The input and output 
sections of the correlator are identioal to those of the analog 



Fig. 27 Digital-rAnalog Correlator 


design. The tape loop is used both as a continuous storage for 
the data and as the coarse time delay element. The reading or 
playback heads will number up to four or six, depending on the 
total number of points desired in the correlation computation. 
During operation only two of the playback heads are used at any 
one time. The signals from these two heads are demodiilatdd and 
then quantised to 2- or 3-^bit numbers. 
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The delayed, quantized signal is then fed to the shift 
register through a switch. Rather than switch the five outputs 
of the shift register after eaoh data pass, the single input 
line to the shift register is switched to obtain the proper set 
of delays. Because the shift register is a rather expensive 
item, it is most desirable to limit the length to a reasonable 
value and operate it in conjunction with a tape loop rather 
than to build the line long enough to accommodate the maximum 
time shift in the correlation. As a result the line length was 
chosen to be 100 units long. Thus, with the five adjacent out¬ 
put lines, a total of twenty possible input lines are available 
from the switch. 

Because of the even function property of the autocorrela¬ 
tion function, only one signal needs to be delayed. For orbss- 
correlation, the negative values of time shift can be had with 
one register by simply interchanging the two input signals. 

The total number of elements in the shift register is equal to 
the bit size of the input data multiplied by the register 
length. For 2- and 3-bit numbers, the number of elements is 
200 and 300, respectively. The cost of such a line is about 
the same as that of the basic magnetic drum; but the shift 
register has no moving parts, and hence, tends to be a much 
more reliable device. 

Although the shift-register-tape-loop combination does not 
have the versatility of available time shift values as does the 
magnetic drum system, considerable increase in the grange of 
time shift values can be obtained if the read heads on the tape 
loop are spaced nonuniformly, as shown in Fig. 28. Thus, with 
six playback heads on the loop and a little ingenuity in mani¬ 
pulation, a correlation containing better than 2200 points is 
obtainable. 

For the 2- and 3~bit situations, a multiplier of the 
matrix type is ohosen from the standpoint of economy and sim¬ 
plicity of construction. The correlator scheme shown in 
Fig, 27 utilizes the hybrid matrix multiplier as described 
previously (Fig. 19) because the resultant analog output is 
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more easily integrated. Accumulators tend to be more costly 
than true simple feedback integrators. The remaining part of 
the system is identical, to the analog system, and attention is 
therefore directed to the discussion in the pertinent sections 

of Chapter III for details of 


HEADS 
0-5 | 

0-10 | 
0-20 | 


illilt 4 ■ 


SPACING 

!_I_ 


16 


Fig. 28 Head Stagger Scheme 


component operation. Had an 
accumulator and straight 
matrix multiplier been used, 
the output equipment would be 
arranged as in Fig. 20. It 
must be pointed out that the 
hybrid multiplier, electronic 
integrator system has a cali¬ 
bration problem, since all 
channels must have identical 


gain and dynamic characteristics. The problem here is of much 
lower magnitude than in the all-analog correlator. The all- 
digital system is subject to drift only as it affects the 
demodulator and quantizer. The digital system in general will 
tend to be a more reliable system with fewer maintenance and 
calibration problems than the analog systems. The digital 
system has no moving parts other than the tape loop, commutat¬ 
ing switches, and recorder. The operation of the digital 
system is much less dependent on tube characteristics than 
the analog system. 


D. COMPUTATION OF SPECTRA 

As has been suggested elsewhere in this report, it is felt 
that spectrum analysis should be used to support the correla¬ 
tion function interpretation. In its study of many physical 
processes, the Servomechanisms Laboratory has had the occasion 
to develop a series of Fourier transform programs required to 
compute the spectrum from the correlation function. The pro¬ 
grams were written to operate on the Whirlwind I computer. 
Spectral studies require a Fourier transform computer program 
of moderate variability. Because the correlation functions 
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obtained may vary in length, the program must be able to' handle 
correlations of say 100, 200, 300 , or 400 pts. 

A problem that arises in the computation of spectra is 
that of minimizing the errors that result from truncation 
(finite correlation function length). This problem is consid¬ 
ered in detail in a Servomechanisms Laboratory report ( 23 ), and 
new weighting functions are introduced in the computation proce¬ 
dure to reduce the errors due to truncation. The new weighting 
functions suppress the spurious oscillations due to truncation, 
but also tend to slightly broaden sharp peaks occurring in the 
spectra. The weighting function does not cause frequency shift 
of the major frequencies in the spectrum. Relative amplitudes 
between peaks in the spectra are preserved to an interpreable 
degree. By varying the weighting function used and by care¬ 
fully measuring the amount the spectrum grows , one can not only 
tell that the frequency components are densely packed but can also 
make very good estimates of the!precise distribution and ampli¬ 
tudes of the component frequencies. Thus, it would be highly 
desirable to be able to chahgb the weighting function in the 
program. 



APPENDIX 


CORRELATION DETERMINATION USING FILTERS 

This appendix contains a simple derivation of the relation 
that must exist between the filters in order that the corre¬ 
lation function of the original data be simply recovered. 

Figure A-l shows the filtering scheme used. 
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Fig. A-l Possible Filter Scheme to Aid in Correlation Deter¬ 
mination 
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The scheme is first worked out for autocorrelation. The 
power-density spectrum of the input is given by # vv (s) -- the 
Fourier transform of the data correlation function. The 
correlation computation is carried out on the filtered signals 
v^ and v^» The transforms of these correlations are given in 
terms of $ 

vv 


(s) as 
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v l v l 

= G 1 (s) 
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V V ^ 
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Adding ttldsb tVro equations gives 

+ v <s) “ fG 1 (s) G^-s) + G 2 (s) G 2 ^“ s )3 $ vv (s) 
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If the filters are chosen such that 

^(s) G- 1 (-s) + G 2 (s) G 2 (-s) - 1 

then the correlation function of the data can be found exaotly 
by adding the correlation functions of v^ and v 2 beoause of the 
additive property of the Fourier transforms. A simple example 
of a pair of suoh filters is 

G- (s) = i l (low-pass filter) 

G 2 («) = ‘ " ‘ T g"^y" (high-pass filter) 

If this scheme is to be applied to cross-correlation 
determination, identical filters must be placed in each channel* 
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PART II 


A TWO-LEVEL REAL-TIME CORRELATOR 


by 


Roy K. Angell 



INTRODUCTION 


This thesis covers an investigation of computation of 
correlation functions by a small special-purpose electronic 
computer. The heart of this correlator is a ten-element 
magnetic oore shift register which acts as a variable delay 
device. Analog information, quantized to two levels, is fed 
serially into the shift register. The parallel outputs of the 
ten oores are multiplied by the output of the last core , and 
the products are averaged by a low-pass filter. Thus, ten 
points on a correlogram are being formed simultaneously. A 
greater number of points could be computed by adding more oores 
to the shift register. The increments and total range of t are 
determined by the sampling rate which can be varied through the 
range 4 kcs to 10 kcs in this correlator. 

The thesis required a study of two important questions. 
First, the quality of correlograms which result from the ultimate 
in quantization coarseness (two levels), was studied. Secondly 
the problem of building a simple real-time correlator was inves 
tigated. As a vehicle for this study, a correlator was 
constructed using vacuum tube pulse circuits and the magnetic 
core shift register mentioned above. 

The correlator was used to obtain correlograms of both 
periodic and random time functions. The results show that a 
one-bit correlator will furnish the principal characteristics 
of a correlation function. Thesei tests are described, and an 
evaluation of the results is made in Chapter IV. 

In Chapter I brief descriptions are given of the two basic 
forms of correlators, analog and digital, together with a little 
history of their origin. This chapter attempts to summarize 
briefly the theoretical background for the problem of perform¬ 
ing electronic computation of correlation functions and, in 
particular, the theory as it is related to the cbrfelatbV 
described in this thesis. Source material is abundant , but no 
single treatment of all aspects was found. Therefore, the first 
chapter is devoted to a synopsis of the pertinent theory. 
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Chapter II shows the approach that was made in translating; 
theory to circuitry. The problem considered is exactly what, 
when, and how is information to be plaoed into, and taken out 
of, the magnetic core shift register. To obtain the answer tq 
this question required considerable study of the shift register. 
Lastly, the problem of how to handle the information obtained 
from the register is discussed. 

The circuit descriptions of Chapter III have been kept as 
brief as possible. As constructed, the apparatus performs 
autocorrelation, with the modifications required for oross- 
correlation having been pointed out in Chapter II. The corre¬ 
lator was constructed as a "breadboard" design, all mechanical 
and electrical work being done by the author. No discussion 
is made of the operation of basic circuits, such as multivibra¬ 
tors, coincidence gates, clippers, and amplifiers, since this 
information is available in many texts. The material presented 
here is. related to the manner in which these circuits operate 
in this correlator. 

As noted previously, a discussion of the tests performed 
on the completed correlator is contained in the last chapter, 
together with some general conclusions. 



CHAPTER I 


HISTORICAL AND THEORETICAL BACKGROUND 

Analysis of periodic and aperiodic functions in the 
frequency domain by Fourier methods has been used by communica¬ 
tions engineers for a long time* By these methods a signal can 
be described by its power-frequency spectrum. This spectrum 
can be obtained experimentally by averaging the output of a 
selective filter at adjacent points throughout the bandwidth 
of the signal. As the filter bandwidth is narrowed indefi¬ 
nitely (the number of adjacent points increased indefinitely) 
and the averaging time is lengthened, the signal is specified 
more completely. Fourier series or Fourier integrals are not, 
however, adequate for the mathematical analysis of random time 
functions. Analysis in the time domain, by means of the 
correlation functions of statistics, furnishes another means 
of attacking the latter problem. Such analysis of time func¬ 
tions has been developed rather recently.* The initial work 
of Wiener was developed for practical use in communication 
engineering by Lee (2). A brief chronology of early papers 
developing statistical theory may be found in (19)* Considera¬ 
ble discussion of statistical analysis as applied to practical 
problems begins to appear in the Research Laboratory for 
Electronics (M.I.T.) Quarterly Progress Reports of 1948 and 
continues from that time forward. It was during that period 
that work on an electronic correlator was begun (18). 


* Refemifee 1 follows an earlier report (1942), by Wiener, 
having th& same title. 
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A. CORRELATION FUNCTIONS 

The crosscorrelation function of the time functions f^(t) 
and fg(t) is defined by the relation 

T 

R 12 (t) = lira f f (t) f (t+T)dt* 1-1 

T-*co *i T 

It is assumed that the time functions f^(t) and fg(t) are 
stationary; i.e., their statistical characteristics are inde¬ 
pendent of the time at which these characteristics are observed* 
When f^(t) = fg(t), the above relation becomes the autocorrela¬ 
tion function of either signal. The quantity t represents a 
displacement in time. 

Another method of describing correlation functions is in 
terms of probability distribution functions. In this case the 
autocorrelation function is described in terms of the character¬ 
istics of any member of an ensemble of random functions. An 
ensemble is a large set (theoretically an infinite set) of 
member functions emanating from identical generators. The 
resulting correlation function is referred to as an ensemble 
average whereas the previous relation is called a time average. 
According to the ergodic hypothesis, the two are equal. The 
following expression shows the autocorrelation function of a 
member function of an ensemble. 

CD oo 

y l y 2 P(y l’ y 2’ T) dy l dy 2 ? 1-2 

- 00 - 00 

p( y l, y 2 , t) is the probability that at any time a member of 
the ensemble will have a value in the range y^ and y^ + dy^, 
and.at a time t seconds later will have a value in the range 
y 2 and y 2 + dy 2 » The foregoing expression becomes a cross- 
correlation function between related random functions if y^ 

* In much of the literature the symbol cp( t) is used to repre¬ 
sent correlation functions. The symbol R(t) is used in some 
of the literature and is used here for ease of manuscript 
preparation. 


R n <T) ■ I I 
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and yg are values f*or two different time functions separated 
by a time t. If these two signals are taken from independent 
processes, the crosscorrelation function reduces to the 
expression 

R 12 (t) = *1 *2 X -3 

which is simply the product of the mean values of the two 
functions. If the signals are not independent and there are 
no hidden periodic components, R-j^t) vr *-^ be asymptotic to 
the value given by 1-3. 

Certain properties of the autocorrelation function in 
relation to the time function from which it is derived are 
listed below: 

(1) It is an even funotion of t. 

(2) The value at t = 0 is the mean square of the 
time function and is the maximum value of the 
autocorrelation function. 

(3) It has periodic components of the same periods 
as the time funotion from which it is derived. 

(4) It discards phase information contained in the 
time function. 

(5) As t-» oo, it tends to the square of the average 
value of the time function. 

(6) The autocorrelation function and the power 
density spectrum are Fourier transforms of 
one another (Weiner 1 s Theorem). 

Some comparative properties of the orosscorrelation 
function are as follows: 

(1) It is generally not an even function of t. 

(2) It does not necessarily have a maximum at t - 0. 

^3) R 12^ = R 21^ " T ^' 

(4) Refer to comments associated with equation 1-3. 

B. COMPUTATION OF CORRELATION FUNCTIONS 

Manual calculation of correlation functions is extremely 
laborious, therefore, many systems have been devised to perform 
the process electronically. (6, 7, 8, 13> 18.) These schemes, 
which implement modified forms of equation 1-1, ftre Of two 
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basic types, the analog (continuous), and the digital (sampling). 
Brief descriptions of an example of each form of correlator are 
given in the paragraphs which follow. 

1 . An Analog Correlator 

i. . .". 1 1 " . <5 

An analog correlator for studying brain potentials is 
described in (8). It performs the operations necessary to 
furnish the result in equation 1-4. The signals are recorded 

T 

R 12 (t) = T - J f l (t) f , 2 (t “ T,dt 1-4 

0 • , 

on magnetic tape;and during analysis the value of t is obtained 
by the spacing, which is variable, of two playback heads. The 
maximum value of r is limited by mechanical design and drum 
speed, unless modifications are made. The correlation function 
is not available until the signals have been recorded and 
played back once for each value of delay. The tape recorders, 
amplifiers, switching unit, playback heads, plotter, etc..make 
a rather large collection of equipment. 

2 . A Digital Correlator 

H. E. Singleton describes a digital, or sampling, correla¬ 
tor in (6). This type forms the correlations in accordance 
with the following relation which approximates equation 1-1 if 
the number of samples N is large, 

N 

R 12* T ^ ‘IT X a j b j 1 “ 5 

j=l ■ 

This is a summation of N products of samples of f^(t) and 
f p (t + t) of amplitudes a. and b., respectively. Singleton, 
although working on one Continuous time function,is essentially 
using an ensemble of time functions because samples are taken 
far enough apart so that the samples are statistically indepen¬ 
dent of one another. A process of this sort is very wasteful 
of information, and the result is an abnormally long time to 
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compute pne point on the correlation curve (order of 20 seconds)» 
In an effort to reduce the time required to obtain a correla¬ 
tion funotion, a five-channel correlator was constructed. (7) 

This latter equipment still required a long time to obtain a 
complete curve of 20 to 100 points. Additional channels might 
be utilized if there is no objection to ttie resulting increased 
equipment complexity* The foregoing processes could be speeded 
up if samples were spaced closely together although their inde¬ 
pendence would no longer be assured. This would require tempo¬ 
rary storage of sections of the input signal with a resultant 
increase in equipment complexity* The resulting time average 
would be approximately equivalent to the average obtained by 
Singleton. According to the ergodic hypothesis, the two would 
be exactly equivalent if the process were carried out over an 
infinite length of time. 

C, LIMITATIONS ON MEASUREMENT OF CORRELATION FUNCTIONS 

In a practical correlator neither the averaging time 
indicated in equation 1-4 nor the number of samples indicated 
in equation 1-5 can be made infinite. To determine the useful¬ 
ness of a correlator as a tool, it becomes important to deter¬ 
mine the errors incurred by utilizing finite observation 
intervals for calculation of the correlation functions. The 
following discussion is a condensation of the results shown 
in (3, 4, and 5)v Intermediate steps in the derivation may 
Ibe found in the references cited; therefore, in the interest 
'&€ brevity they will not be repeated. 

1.. Continuous Correlator 

The following notation will be used in the discussion 

R 12 (t 0 ) = fjYt) f 2 (t+r 0 ) » x(t) 1-6 

where tthe bears indicate an infinite time average. In a 
practioall 'Correlator x(t) the instantaneous product of the 
two inputs is formed, and this is fed into an averaging or 
integrating device tfhich usually has the form of a low pass 
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filter. The output, y(t), of the filter is 'the convolution df 
the filter's impulse response and the input, x(t). It is 
assumed that the filter is passive, having an impulse response 
which is h(t) for 0 < t < T, and is zero elsewhere. The result 
ing time average reduces to the expression 

co T 

y(t) = r 12 (t 0 ) ^ h(T,T)dT = r 12 ( t 0 ) f) h( t )dT 1-7 

- oo 0 


Now the root mean square (RMS) of the variations of the corre¬ 
lator output about its mean value gives a measurement of corre¬ 
lator error or noise. It is indicated by the symbol<r and is 
defined by the relation 


. . - 2 - ___ 

^y. 2 - Xy(t) - y(t) ] 5 y 2 (*) ~ y(t) 2 1-8 

It is desired to minimize or in relation to y(t) or to maximize 

• y ■- 

the following signal-to-noise ratio which give's an indication 
of the correlator accuracy. 


JL a -llLl 

N y 


1-9 


where y(t) is given by equation 1-7. 

Let us define a new variable, Z(t), as the variation of 
the product function x(t), about its mean. 

Z(t) = x(t) - ritT 1-10 

then 

r z (t) = r x (t) - rrtT 2 i-ii 


Now if the input to the averaging filter were white noise with 
a spectral density of unity , the autocorrelation function of 
the output would be 

oo 

R h ( T ) E ~ J H(w,T) 2 e jwTl dw 1-12 

- OO 
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The mean square error of the output may be expressed in terms 
of correlation functions defined in equations l-ll and 1-12 as 
f ollows: 


f 


€0 


V T > 


V T > 


dT 


1-13 


Remembering that the impulse response of the filter was 
non-zero only over the interval 0 < t < T and remembering that 

r 't 

autocorrelation functions are even functions, then equation 1-9 
becomes: 


S, 

N 


R 12 (T 0 ) J h(T) dT 
0 


2 f R z (t) R h (x) dr 
0 


1/2 


1-14 


Thus, it is seen that the signal-to-noise ratio depends on the 
statistical properties of the input signals as well as the 
characteristics of the averaging filter. Interpretations of 
equation 1-14 for certain specific cases are made in the 
discussion that follows. 


2 . C ontinuous Averaging with an Ideal Integrator 

If the averaging device is an ideal integrator having an 
impulse response equal to one for 0 < t < T and sero elsewhere, 
equation 1-14 will take the following forms: 


As T —*■ 0 







xM 

<T 


1-15 


This is simply the signal-to-noise ratio at the output of the 
multiplier and is independent of T. 


As T co 


S 

N 


rr 

T 

J <1-^) R z (t) dT 
0 


l/2 


1-16 


2 
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3. Continuous Averaging with a Low-Pass Filter 

If the averaging device is a low-pass RC filter with an 
impulse response ae~ a ^ for 0 < t < T and zero elsewhere, 
equation 1-14 will take the following forms: 

As T becomes small compared to the filter time constant, 
—, the signal-to-noise ratio approaches that of equation 1 - 15 . 
(This is equivalent to saying that a low-pass RC filter acts 
as an ideal integrator for periods of time short in comparison 
with the filter time constant. 



Thus, for the extreme cases (very short or very long averaging 
times), the signal-to-noise ratio is independent of T. For 
intermediate ranges of T, equation 1-16 will hold for the RC 
filter case as well as for the ideal integrator. 

The foregoing relationships are summarized in Fig. 1-1 
which shows noise-to-signal ratio j 1 , for power 



measurements, R^(0), on a random signal of bandwidth W. The 
curves are similar to those found in ( 5 ). The horizontal axis 
is a dimensionless integrator "time" obtained by multiplying 
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signal bandwidth and real time, necessary to obtain a specific 
measurement accuracy on a signal of known bandwidth. 


4. Correlation on Sampled Incuts 

In most practical cases sampling is done periodically 
rather than at random. Therefore, only the periodic case will 
be treated here. For equal averaging times the errors in 
correlating a sampled input will be greater than errors result¬ 
ing from the use of a continuous input. This is to be expected 
since sampling discards information between samples. 

Costas (3) develops the following formula for the mean 
square error of a sampled function (variance of the sampled 
mean). 


”■ z = V + \ I 2 < n -*> R < kt 0> + 


= variance of unsampled function 
m = mean of unsampled function 
n ~ number of samples 
tg = sampling interval (ktg--*’ t) 


1-18 


If each sample is statistically independent in equation 1-18, 
this reduces to the expression 



1-19 


Davenport (4) derives a similar expression and incorporates it 
into several formulas for signal-to-noise ratio simplified to 
describe a number of special cases, First , if a given number 
of samples are taken in an interval T—♦0, then the result 
approaches equation 1-1.5 • This is intuitively obvious since 
the above procedure approaches the continuous sampling case. 
There are two important results for cases where the averaging 
time becomes large. First, if R^tT)—see equation 1-11-- 
contains a periodic component whose period is the same as the 
sampling period, then the signal-to-noise ratio becomes 
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independent of the averaging period and the number of samples. 
This case should be avoided since the periodic signal will be 
translated as a d-c level. The second case, where the sampling 
period is not related to any periodic components of the input 
signal, is given by equation 1-20. 

As T —*■ oo Jr 

This result shows that the number of samples must be increased 

by a faotor of four to double the signal-to-noise ratio. In 

T 4 

practice orders of magnitude of lO-' to 10 samples could be 
accumulated until the correlation function shows that further 
accumulation is not changing the results materially. 

D. EFFECTS OF SAMPLING AND QUANTIZATION (9, 20) 

In forming the correlation function, the operations of 
time delay, multiplication, and averaging must be performed. 

In using a digital machine to perform these functions, the 
inputs are first sampled and quantized. What effect do these 
operations, made necessary by the nature of the niachine , have 
on the resulting oorrelogram? 

1. Sampling 

The process of sampling a time function may be described 
as modulation by a train or sequence of unit impulses spaced 
at some time interval T. (20) The output of the sampler, or 
impulse modulator, is a train of impulses, each having an area 
equal to the amplitude of the input function at the sampling 
instants. In forming a correlation function, there is a time 
delay and multiplication involved. In order to form non-zero 
products, the time delay must be an integer multiple of T. 

This means that the resulting oorrelogram has discrete values 
at intervals of T and is zero in the intervening spaces. The 
complete oorrelogram is an envelope that passes through the 
discrete values# As T is made shorter, the envelope: is more 
completely specified. 
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It is helpful to look at the process of sampling in the 
frequency domain as well as in the time domain. If the input 
time function has a transform denoted by F(s), then the sampled 
transform F*(s) is related to it by the following equation: 



where n is an integer and W is the sampling frequency (W=2tt/t). 
It can be seen that if F(s) has frequency components greater 
than w/2 , then the sampled spectrum components will overlap and 
F(s) oannot be recovered. This is the basis for the Nyquist 
sampling criterion which says that the sampling frequency must 
be at least twice the highest frequency present in the unsam¬ 
pled function. Of course, the problem here is not the recovery 
of the original function. The correlation function is the 
Fourier cosine transform of the power density spectrum which is 
related to the frequency spectrum as follows: 



(w) 


lim 4r F.. (w) 
T—- oo 


1-22 


The Nyquist sampling criterion still applies if the form of the 
power density spectrum is to be preserved. Therefore, the sam¬ 
pling requirements for recovery of time functions apply to the 
computation of their correlation functions. 

2. Quantization 

Quantization is the process of analog-to-digital conversion 
required when the correlation function is to be oomputed digit¬ 
ally in accordance with equation 1-5* All amplitudes in a given 
range, or box size q, are given a discrete value. The recip¬ 
rocal of the box size (l/q) is a measure of the fineness of 
quantization. Widrow (9) describes this process as area sam¬ 
pling and relates lit to the Nyquist sampling theory. He shows 
that the Fourier «tr«ansform (or characteristic function) of the 
probability distribution function of a signal is periodic if 
the signal is quantized. The radian fineness of quantization 
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2-n/q must be large enough to separate the components of the 
periodic characteristic function. This form of a Nyquist 
criterion is in terms of the statistical characteristics of 
a signal rather than of the signal itself. This suits our 
interest in restrictions on the reoovery of the correlation 
function which is a statistical property of the input signal. 

Quantization introduces a signal distortion referred to 
as quantization noise. For Gaussian distributed inputs Widrow 
relates the correlation of the quantization,noise to the normal- 
lized correlation of the quqntizei^ input signals, with the box 
size q as a parameter. The normalized correlation of quantizer 
input signals is the mean of their product divided by the 
mean square (X^Xg/c ). The case of particular interest here is 
for q=2 cr where <r is the standard deviation of the input sig¬ 
nal. This corresponds to a, box size approximately one third 
the dynamic range of the input signal. When the input correla¬ 
tion coefficient for this box size is less than 0.6, then the 
quantization noise is practically uncorrelated. Even when the 
input correlation coefficient is 0.9, that of the quantization 
noise is only 0.3. This suggests that three-level quantization 
would be adequate to obtain correlograms of reasonable accuracy. 

The foregoing theory has been verified experimentally and 
was carried a step further by Kaiser. (21) He compared the 
results of two-level (one-bit) quantization with the results 
of eight-level (3-bit) quantization on the correlation function 
obtained from human brain potentials. . With the extreme quan¬ 
tization coarseness, the major characteristics of the correla- 

i 

tion function were retained.* This was a strong motivation for 
the initiation of this thesis investigation. 

Some interesting results related to two-level quantization 
were published in 19^3* (25) Van Vleck showed that when 

Gaussian noise signals are clipped (quantized) to two levels, 


* It is interesting to note in relation to the statements of 
Section C-4 of this chapter, that only 650 products were 
used to obtain the points of these correlograms. 
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the resulting correlation function is proportional to the arc 
sine of the correlation function of the input without clipping. 
His derivation is summarized in Appendix V. 



CHAPTER II 


GENERAL DESIGN CONSIDERATIONS 


To perform autocorrelation or crosscorrelation electronic¬ 
ally, the required, mathematical manipulations must be trans¬ 
lated into suitable circuitry. Provision must be made to 
perform the following functions; 

(1) furnish time delays of various magnitudes 
corresponding to values of t 

(2) perform multiplication 

(3) sum and average the results of the above 
multiplications 

(4) reoord or display the resulting correlation 
function 


The first function, that of obtaining time delays, may be 
accomplished in a variety of ways. Lumped parameter electrical 
networks, phantastron delay circuits, magnetic tape, storage 
tubes, and various mechanical methods might be used for this 
purpose. Each has certain advantages and disadvantages as can 
be seen by reference to other writings. See, for example, 

(6, 7, and 8). The magnetic core shift register.offers an 
inviting method of obtaining all desired values of r simul¬ 
taneously. To understand the problems involved, a study of 
the magnetic core shift register is necessary. This is done 
in the next section of this ohapter. 

The second function, that of multiplication, can be 
performed on the digital output of the shift register by some 
form of AND circuit or coincidence gate. In the synthesis of 
a correlator the details of circuit construction are reasonably 
straightforward. It is important, however, to have a knowledge 
of where the various circuits are to be used and the time 
sequence of their operation. These latter topics are the 
subject of the second section of this chapter. 

The third function involves the process of integration. 


Electronic integration brings to mind 
relationship of capacitors; i.e. , e = 


the 


voltage current 
i dt. The discussion 
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of averaging circuits, which will be made later, rests heavily 
on this "integrating" property of capacitors. 

After the correlation function has been computed, it is 
equally important that the results be made available in a use- 
able form. Many schemes have been worked out for recording and 
displaying information. The last section of this chapter will 
discuss briefly the problem of a display circuit for this 
correlator. 

A, THE MAGNETIC CORE SHIFT REGISTER 

The correlator described in this thesis is built around 
the ability of the magnetic core shift register to accept 
binary information in time sequence, store this information, 
then read it out in parallel form at the occurrence of a pulse 
acting on all cores simultaneously. Although in this case a 
series-parallel transformation is made, it should be noted that 
these shift registers may be used for parallel-series operation 
should this be desirable. 

Magnetic core shift registers are of two basic types: the 
single-line register using one magnetic core per binary digit 
and the double-line register using two magnetic cores per digit. 
To appreciate the differences in operation of these two types 
of registers, the following points should be kept in mind. 

First, interrogation of the magnetic core is destructive of the 
information in that core; and second, information cannot be 
placed into the core while interrogation is in process. These 
characteristics of the cores results in the following restric¬ 
tions on their use. Interrogation (or reading) of a core and 
shifting information toward the next core must be done simul¬ 
taneously*, whereas interrogation and writing into a core must 
not be done simultaneously. In practice this means that the 

* It is possible to make an exception to this statement. With 
the use of additional circuitry, the information in a core 
could be temporarily stored during interrogation or shifting 
and then written back into the same core. Special schemes 
have been devised for non-destructive interrogation of 
magnetic cores, but they have not been made practical as yet. 
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shift pulse should also cause the core contents to be trans¬ 
mitted to the output circuits. In other words, the shift and 
read pulses are one and the same. Since a core oan store only 
one digit at a time, it must be cleared before another digit 
is written into it. This is most easily done by reading and 
shifting all cores in a line simultaneously. The information 
shifted out of each core must be stored temporarily until read 
out is finished; then, it may be written into any of the 
oleared oores (including itself if suitable connections are 
made). The single-line register accomplishes storage by means 
of an RLC or RC delay network between cores. The double-line 
register uses another core for storage. This means that the 
latter register requires twice as many cores as the single-line 
register to perform the same functions. Furthermore, the 
single-line register, with its single-shift pulse line, uti¬ 
lizes simpler driving circuitry than the double-line register. 

A single-line register, with an RLC intercore network was used 
for this thesis work. Binary digits ZERO and ONE advance 
serially through the register, all cores being interrogated 
in parallel, at periodic intervals, by a shift pulse. Experi¬ 
ence as far back as 1953 showed that as many as fifty stages 
of a single-line register could be cascaded, and that they 
could be operated at frequencies up to 100 kc/second. (10) 

Each magnetic core in the register has three essential 
windings which control, or are controlled by * the core's 
rectangular hysteresis loop*. See Fig. 2-1. The cores are 
controlled by a shift pulse which operates to simultaneously 
place all cores of the register in the ZERO state of magneti¬ 
zation. If a core is in the ONE state, the shift pulse causes 
a sudden reversal of flux with a resultant large voltage across 
the output winding. This corresponds to a flux change AB=B m ~B r 
in Fig. 2-1. If the core had been in the ZERO state, the shift 
pulse would cause a small, but not negligible, output voltage 

* Some dimensioned hysteresis loops for actual cores may be 
found in Chapter II of Reference 11. 
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since the hysteresis loop is not perfectly rectangular (the 

residual flux is less than the maximum flux). This voltage 

results from the flux change AB = B + B . As will be discussed 

m r 

later, there must be absolute discrimination against ZERO’s in 
the output circuits of this correlator. The write pulse, when 
present , occurs between shift pulses and always places the core 
in the ONE state. Absence of a write pulse corresponds to the 
binary digit ZERO. 


I s 1 SHIFT PULSE CURRENT 
l w * WRITE PULSE CURRENT 
E 0 * OUTPUT VOLTAGE 


• 4 




B r = RESIDUAL FLUX DENSITY 

B m * MAXIMUM FLUX DENSITY 

+H * SHIFT PULSE 

MAGNETIZING FORCE 

-H= WRITE PULSE 

MAGNETIZING FORCE 


Fig. 2-1 Idealized Magnetic Core and Its Hysteresis Loop 

It should be noted that each core acts like a magnetic 
amplifier with the shift pulses furnishing the added energy 
necessary to make up for losses as information passes along 
the register. As will be explained later, the write pulse sees 
a virtually unloaded core whereas the shift pulse is heavily 
loaded by the intercore network. 

As noted previously, an RLC intercore network prevents 
simultaneous occurrence of a write and a shift pulse in any 
core except the first one of the register. External circuitry 
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must insure that write-in to this first core does not coincide 
with the shift or read-out pulse. The diode of Fig. 2-2 pre¬ 
vents discharge of the capacitor back into the output winding. 
This diode is back biased during the write pulse , hence the 



output circuit does not load the core during write-in. The 
shift pulse causes only a negligible output back into the write 
winding because of the turns ratio and high impedance looking 
into this winding. The low impedance looking toward the output 
winding strongly favors transfer of energy to this winding. 

In the design of an instrument utilizing a magnetic core 
shift register, it is important to know the required character¬ 
istics of the shift and write pulses. If a core is unloaded, 
the energy supplied by the shift pulse to switch the core from 
the ONE state to the ZERO state is 

B T 

W = (volume) m H dB = E(t) l(t) dt 2-1 

s -B 0 

r 

Where H and B have the meaning shown in Fig. 2-1, T is the 
duration of the shift pulse and E(t) and I(t) are the voltage 
and current associated with the core winding during the pulse. 
The flux density is related to the magnetizing force by the 
characteristics of the core which are represented by the 
hysteresis curve, and the magnetizing force is a product of 
current and the number of shift winding turns. All of this may 
be summarized in the basic fact that the switching energy is 
related, to a time integral of shift pulse current. This means 
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that for a given core there is a minimum shift pulse current 
and duration required to switch the core. Additional energy, 
not accounted for in the above discussion, must be furnished 
to supply losses and the core load. 

The time required to switch the core varies with the 
applied magnetizing force. It has been found empirically that 
the product of switching time and magnetizing force is approxi¬ 
mately constant over a wide range of operation. For purposes 
of this thesis, the switching time (which is short compared to 
planned operating frequencies) is not critical. Therefore, 
design will not be concerned with providing additional energy 
in the shift pulse source for the purpose of reducing switching 
times. It is important, however, that sufficient energy be 
supplied to insure complete switching every time a shift pulse 
occurs. Partial transition may result in subsequent erroneous, 
transitions of core state. For example, if a core in the ONE 
stat’e is only partially switched and the next input is a ZERO, 
the next shift pulse may add sufficient energy to create a 
spurious ONE in the output. More detailed discussion of this 
last possibility, as well as a more complete discussion of 
magnetic core energy relationships, may be found in (11 and 14). 

In addition to the minimum pulse duration requirement, 
which is dictated by energy considerations, there is also a 
maximum allowable pulse duration for single-line registers. 

This requirement is dictated by*the intercore network. The 
shift pulse must end while the intercore storage capacitor 
still has the energy to make a complete write-in on the follow¬ 
ing core. A shift pulse of excessive length will actually 
erase all 0NE*s from the register. One further point: the 
shift pulse source should appear to be an open circuit between' 
pulses in order not to load the write winding during the write 
pulse. As previously noted, a back biased diode keeps the 
output winding open circuited during write-in* 

The manufacturer built the intercore network into the 
register available for this thesis*as well as having fixed the 
core material and turns ratios. Design is, therefore, limited 
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to providing for a shift pulse current of proper magnitude and 
duration so that the cores are switched completely and write 
pulses are not destroyed during write-in. A write pulse source, 
activated by the input time function, must supply a current 
pulse of proper magnitude and duration to write into the first 
core. Although nothing has been said about pulse shape, the 
rise and fall times of the pulses may have an effect on the 
stability of operation; and this possibility must not be 
overlooked. 

In summary, the foregoing discussion points up the 
following design considerations necessary to properly incor¬ 
porate the magnetic core shift register into the correlator: 

(1) Ttyere mijst be a shift pulse source which 
supplies a current pulse of proper amplitude 
and duration so that complete switching is 
accomplished every time. 

(2) Analog input signals must be converted to 
digital current pulse of proper amplitude 
and duration to write into the first core in 
the line. Because quantization is to be con¬ 
fined to two levels, this should be relatively 
easy to do. 

( 3 ) Attention should be given to the optimum rise 
and- fall times of the pulse by observing the 
effect of varying these quantities on the 
operation of the register. 

(4) Provision must be made to insure that the 
write pulse going into the first core does 
not coincide with the shift pulse. The inter- 
core network takes car© of this function for 
other cores provided the shift pulse is not 
too long. 

( 5 ) The cores must not be too heavily loaded by 
output circuitry. 

B. OPERATIONAL TIME SEQUENCES 

Assuming that the basic sampling frequency has been 
determined in accordance with the principles outlined in the 
previous chapter, it next becomes necessary to plan for the 
sequence,,of events dictated by the magnetic core properties 
and the associated,circuitry. This sequence must properly 
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irfrjileHtent the mathematical expression for correlation without 
violating conditions imposed by the "hardware." 

Let us assume a sampling rate of 8 kc/second is being used 
and the magnetic cores require a shift pulse of approximately 
8 microsecond^ duration. Thus, all cores are receiving an 
8 -microsecond shift pulse every 125 microseconds. Sampling of 
the input must occur at the same frequency as the shift pulse 
to provide information to the register at the same rate that 
it advances through the register. It might be helpful to think 
of the process as quantization in time. All the information in 
a 125 -microsecond section of the input function is quantized to 
one discrete value. In this correlator, two-level quantization 
in amplitude takes place at the input; hence, the discrete 
value is a binary digit, ONE or ZERO, and only one core is 
required to store all the information that is accepted in the 
125 -microsecond section of time. A ten-core register contains 
a representation of 1250 microseconds of the input function, 
provided an 8 kc/second sampling rate is being used. The 
entire register acts as though it were a 1250 -microsecond 
"window" that moves back 125 microseconds along the input func¬ 
tion with each shift pulse. 

Before following through a sequence of operations, one 
point should be stressed. Information cannot be written into 
a core during a shift pulse. This means that sampling must 
occur between shift pulses. The easiest method of insuring 
proper write-in is to control the sampler by the trailing edge 
of the shift pulse. The discussion that follows is related to 
the flow chart in Fig. 2 - 3 . The shift pulse period is given 
the general value T. For purposes of illustration, only four 
cores are shown and all are assumed to be in the ZERO state 
initially. At time t = 0, the correlator is started and the 
first shift pulse occurs. Delta microseconds later (width of 
shift pulse = A) the sampler operates to place a binary digit 
into the first core. At the occurrence of the fifth shift 
pulse (t = 4T), this digit is read out of the last core. It 
is then used to gate (multiply) parallel outputs from all cores 




Fig. 2-3 Time Sequence Flow C 


O+A 


notes: 

O) A * WIDTH OF SHIFT PULSE 

b) PERIOD OF SHIFT PULSES = T 

C) (3T+AK0+A) INDICATES THE 
PRODUCT OF BINARY DIGITS AT THE 
TIMES INDICATED. 

d) THE CORRELATOR WAS STARTED 
AT t = 0. THE DIAGRAM SHOVES t*4T 
JUST AFTER THE FIFTH SHIFT PiK SE. 


O 

-4 
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including its own. From this time forward, every shift pulse 
results in four products (in this example). The products are 
summed, averaged, and displayed as four points on a correlation 
curve R(t), where t = 0, T, 2T, and 3T microseconds. 

It should be remembered that the increments of t are equal 
to the sampling period which is also the period of the shift 
pulse. A high sampling frequency will result in small incre¬ 
ments of t and hence a smaller total range of t for any given 
number of cores. If it were necessary to increase the range 
of t without adding cores or decreasing the sampling frequency, 
it might be possible to use the same cores for an extended 
range. For example, suppose that in the above system the out¬ 
put from the last core were continuously recorded on a magnetic 
tape and then read by a pickup spaced so that a delay of 4 t 
microseconds was sustained. The output from this pickup could 
then be used to gate the four cores with a resulting correla¬ 
tion curve for t = 4T, 5T» 6T, and 7T microseconds. Thus, it 
is possible to obtain a complete correlation curve for any 
range of t by taking it in sections. Obviously, this procedure 
would lengthen the time required to obtain a complete correla¬ 
tion function. However, there is a limit to the number of 

4 

cores that may be cascaded; therefore, the latter procedure 
might be necessary in cases where the nature Of the input func¬ 
tion necessitated a high sampling frequency (corresponding to 
a short total range of t for a given number of cores). 

Although in the previous discussion the last core was used 
for gating the output of all the cores, it could just as well 
be done by the first core. As a matter of fact, gating could 
be done by a binary sample from the input function. In this 
case, however, the sample must not be delayed in the manner 
required for proper write-in, but must occur at the time of the 
shift pulse in order to coincide with the outputs from all 
cores. Use of the last core appears to be simpler, and it does 
insure that the register has a complete section of the input 

T 

when the first multiplying pulse occurs at the output gates. 
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To perform crosscorrelation, the second function, after being 
quantized, could be used to do the gating to the averaging 
c ircuit s. 

If the input function is removed before the correlator 
is turned off, a few shift pulses will soon clear all cores 
to the ZERO state. 


C. SUMMATION AND AVERAGING 


Summation and averaging will be the function of an 
integrating circuit. Discussion in the previous chapter 
indicated some of the factors to be considered in determining 
the proper number of samples or the averaging time required to 
obtain a correlation function with small errors. In practical 
correlators various provisions have been made for these factors. 
For example, the analog correlator of (8) makes provision for 
integration with one per cent accuracy for periods as long as 
50 seconds but also makes use of a 10-second period. Cowley's 
correlator ( 13 ) makes use of a low pass averaging filter which 
integrates signals of frequencies above 15 cycles per second. 
Levin (7) makes provision for obtaining from 4,000 samples to 
16,000 samples for each point on the correlation curve. The 
time or the number of samples required is related to the statis¬ 
tical characteristics of the input signals, and these may not 
be known. The exact requirements for the integrator may be 
found by experimentation with the class of signals being inves¬ 
tigated. This was discussed in the first chapter. Here the 
discussion relates to the type of circuits that may be useful. 

The step response of an ideal integrator is a ramp. The 
low pass RC filter approximates this for a limited time if it 
has a long time constant. Consider the filter of Fig. 2-4a 
where the following relation applies: 

E o - i- 1 1 dt = ife I dt 2 - 2 



E (1 


2-3 
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To increase the linearity of integration, it appears only 
necessary to increase the values of resistance and capacitance. 
However, in a simple RC integrator this will result in an 
extremely low gain Eq/e for a given integration time; and, in 
any event, this method is limited by the values obtainable 
with practical components. Capacitor leakage resistance and 



b) MILLER INTEGRATOR 



C) BOOT STRAP INTEGRATOR 


Fig. 2-4 Basic Integrator Forms 

external loading limit the time constants available in a simple 
RC circuit. One method of obtaining a large effective capaci¬ 
tance is to use a Miller integrator. See Fig. 2-4b. Here a 
capacitance between grid and plate of an amplifier stage 
appears to be multiplied in size by one plus the amplifier gain. 
Also, the ratio E q /e is multiplied by the gain of the amplifier. 

If the current into the capacitor of the low-pass RC 
filter were constant , the integration would be ideal. This 



current is i 


R 


A constant current input could be 
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oMained by raising the input voltage at the same rate as the 
capacitor voltage. This may be accomplished with a unity-gain 
feedback amplifier as shown in Fig. 2-4c. The result is called 
a bootstrap integrator. Derivations of the gain relations 
shown in Fig. 2-4 are presented in Appendix I. One more method 
will be described after a few introductory remarks. 

The simplified process being carried out in a one-bit 
correlator gives rise to other possibilities. The mathematical 
expression for the correlation function is repeated here for 
ready reference in the discussion that follows. 

r(t > .* -f X a j b j z - 4 

j 

Since quantisation is carried to only two levels, the values 

of a. and b. are 1 or 0* The following products are defined: 

0 J 

1x0 = 0 1x1 = 1 

0x1 = 0 0x0 = 0 

Therefore, the product a .b . is always a 1 or 0.* This means 

J J 

that the correlation funotion can be obtained by simply averag¬ 
ing the long time rate at which ONE products are obtained. 

This is equivalent to making an average frequency measurement. 

A device for measuring the frequency of voltage pulses is the 
counting rate meter used in atomic radiation instruments. ( 15 ) 
Consider the circuit shown in Fig. 2-5 which shows the 
basic configuration for a counting rate meter circuit. 

At the>occurrence of a negative pulse, the capacitor 
charges through diode 1 and the output resistance R^ of the 
pulse circuit. The voltage across at the end of the pulse is 

e = E (1 - e* T//RC ) 2-5 

c 

* On a basis of like products equal ONE and unlike products 
equal ZERO, the ^product 0x0 would also be equal to one. 

The form taken here will result in reduced amplitude of the 
entire correlation function but will not alter its form. 

It is felt ? that this procedure is justified because of the 
simplification in the gate circuits where th&‘ multiplication 
is formed. 
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and is approximately E since T is chosen to be over 5 times 
constants in duration. At the end of the pulse, discharge 
occurs through diode 2 and C 2 R 2 . Now the charge which had 
accumulated on starts to distribute itself between the two 
capacitators so that 


e cl C 1 + e c2 C 2 


= EC, 


= Q 


2-6 


But, when e ^ = e c 2 ’ 2 opens. Then 


e 


c2 



2-7 


Since 0 o » CL , this reduces to e 0 — E 7— or 0 0 C 0 - ECL = Q,. 
2 1 c 2 G c 2 2 1 

2 


The average current through R 2 is 
average rate of the pulses. Then 


then 


where 

y 


_ 1 _ 

y 


N, the 


V = IR 2 = NQR 2 = NECjRg 2-8 

Naturally this derivation holds true only if V « E. 

Notice that the output voltage does not depend on the duration 
of the pulses as long as they are long enough to give C., a full 
charge. A similar analysis, could be carried out for positive 
applied pulses resulting in the same expression for V. 


-E- 


o-vw 


M T 
INPUT PULSE 



Fig.2-5 


T > 5R|C| C 2 » C| V « E 

Counting Rate Meter Circuit 


Another vefy simple averaging circuit would be a parallel 
RC circuit placed in the plate circuit of a pentode gate. Each 
current pulse would place a charge ft = IT on the capacitator. 

If the average number of pulses is N per second, the rate at 
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which charge is deposited on the capacitator is NQ, ~ NIT. The 
average voltago across R is NITR. It is assumed that RC » T. 

Some form of the circuits which have been discussed above 
should be adequate for the averaging circuit. 

D. DISPLAY OF RESULTS 

This problem is largely one of designing a commutator to 
take the outputs from each integrator and convey them sequen¬ 
tially to the display unit. This method, rather than trying to 
take parallel outputs from all channels simultaneously, is used 
in the interest of not requiring an unduly complicated display 
unit. 

The commutator may be electronic or mechanical. One possi 
bla mechanical system would employ a rotary selector switch 
such as has been used in some telephone systems. A set of 
wipers are rotated over a semi-circular bank of contacts by the 
action of a stepping magnet. Each output channel would be con¬ 
nected to one of the contacts in a single layer of the bank. 

The wiper for this layer would be connected to the vertical 
axis of an oscilloscope or other indicator. The contacts of 
another layer would be connected to discrete adjacent incre¬ 
ments of voltage. The wiper of this layer would cause displace 
ment along the horizontal axis of the indicator. As both 
wipers move together, each output channel would have its value 
displayed sequentially at adjacent horizontal positions. A dis 
cussion of the rotary selector switch may be found in ( 17 )* 

An electronic commutator is preferable for high speed, 
clean commutation of many outputs. Petree (16) describes a sys 
tem which has been used with five channels. Its liberal use of 
tubes (3 per channel) is a serious disadvantage in cases where 
many channels are being handled. The diode matrix system 
described by Kilpatric ( 12 ) appears to be the most suitable for 
this correlator and its use is planned* Although synchroniza¬ 
tion with the timing of the other correlator circuits is unnec¬ 
essary, the shift pulse source may be used as a convenient 
source of timing pulses to time the operation of the circuits 
controlling the diode matrix system. 



CHAPTER III 


DESCRIPTION OF CIRCUITS 

In the previous chapter* Fig. 2-3 summarized the necessary 
timing of operations to perform autocorrelation. From these 
time relationships it was necessary to synthesize suitable cir¬ 
cuitry; therefore, the block diagram of Fig. 3“1 was evolved. 
Having a general picture of requirements, the first step was 
to provide a shift pulse source for the magnetic core shift 
register. Next, a circuit for sampling and converting the 
input signal from analog-to-digital form was constructed. 
Finally, circuits for taking the information out of the shift 
register and forming the correlogram were designed and built. 
The descriptions that follow are presented in the order just 
mentioned. 

A. MAGNETIC CORE SHIFT REGISTER 

To determine the requirements for the shift pulse source, 
and also the input circuits, tests were conducted on the 
magnetic core shift register. Ten magnetic oores, manufactured 
by Sprague Electric Company, were available to ma^ce up this 
register. Each core package was complete with a built-in RLC 
delay network but required the addition of a diode (see 
Fig. 3-2). With apparatus available in the Servomechanisms 
Laboratory, tests were conducted to determine the inputs 
required to properly operate the assembled ten core shift 
register. It was found that, with a shift pulse having an ampli 
tude of 175 milliamperes, core switching would occur with pulse 
durations of 3.7 to 12 microseconds. An intermediate value of 
7.5 microseconds was selected as being the optimum value for 
the shift pulse width. The entire shift register operated 
satisfactorily for frequencies up to 12 kilocycles per second. 
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Fig. 3-1 .Correlator Block Diagram (Autocorrelation 
Arrangement) 





TERMINAL CONNECTIONS 



SHIFT PULSE 

TERMINALS: 4;6 
SQUARE SIZE: 50 MILLIAMPS 
2//SEC. 



OUTPUT PULSE 

TERMINALS: l;GROUND 
SQUARE SIZE: 5 VOLTS 
5//SEC. 



WRITE PULSE 

TERMINALS: 9; 10 
SQUARE SIZE: 2 MILLIAMPS 
50//SEC. 


Fig. 3-2 Shift Register 


Connections and Waveforms 
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Two sections of the shift register are shown schematically 
in Fig. 3 - 2. A photograph of the output voltage at terminal 1 
is shown in the same figure. It has an amplitude of 15 volts, 
rise time of 4 microseconds, and decays exponentially with a 
time constant of approximately 18 microseconds. The shift 
pulse and write pulse are those actually obtained with the 
shift-pulse and write-pulse generators constructed for the 
correlator. 

It was found that, with a write pulse width of 15 to 20 
microseconds into terminals 9 and 10 of the first core, a mini¬ 
mum current of 2 milliamperes was needed for write-in. A value 
of 3 to 4 milliamperes was chosen as a design criterion to 
insure complete write-in every time. The foregoing measure¬ 
ments furnished the information needed to design the circuits 
to be used with the register. 

B. SHIFT PULSE GENERATOR 

This circuit is shown in Fig. 3~3- A free running multi¬ 
vibrator using a type 5965 twin triode is the basic timing 
device for the shift pulse generator. By adjusting the posi¬ 
tive grid voltage level, the frequency of the multivibrator may 
be adjusted from 2 kcs to above the 12-kcs operating limit of 
the shift register. The square wave at the cathode of one side 
of the multivibrator tube is differentiated, with the resulting 
positive spikes being used to trigger a one-shot multivibrator. 
A diode in the grid circuit of the one-shot multivibrator pre¬ 
vents preliminary quenching of this circuit by the negative 
input spikes. Actually, this precaution is not essential for 
the present application since the period of the one-shot multi¬ 
vibrator is much less than ope half the shortest period of the 
free-running multivibrator. 

The one-shot multivibrator controls the shift pulse width 
and is set for 7*5 microseconds. The diodes in the grid cir¬ 
cuit of the cathode follower, that forms the next state, accu¬ 
rately control the pulse height. The grid of V3A swings during 
the ?hift pulse (this latter value may be adjusted from 
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approximately 0 to -40 volts by the amplitude control). The 
180 uuf capacitor was added for more stable core switching. 
This capacitor increased the rise time by a factor of about 3 
and reduced overshoot by a factor of almost 10 . The trailing 


+225V 



Fig. 3-3 Shift Pulse Generator 

edge was modified to a lesser extent. The resultant pulse shape 
may be seen in Fig. 3-2. Before this step had been taken, there 
was considerable oscillation at the leading and trailing edges 
of the shift pulse. 

The output of the cathode follower controls a pentode 
current source which drives the shift pulse windings. It will 
be noted that with this arrangement a grounded core winding may 
not be used. The 10-ohm resistor in the plat© circuit is used 
for measuring purposes. 
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C. SAMPLING CIRCUIT 

As was mentioned in Chapter II, write-in must not occur 
during the shift pulse. For this reason, it was decided to use 
the trailing edge of the shift pulse to initiate a gate control 
pulse for the write pulse generator. The output from V3A of 
the shift pulse source is differentiated, and the positive 
spike from the leading edge is clipped in the V3B grid circuit 
(Fig. 3-4). The negative spike from the trailing edge is 


+ 225V. 



Fig. 3-4 Sampling Circuit 

amplified and inverted. It is then used to trigger a one-shot 
multivibrator (V8) which controls the screen grid of the write 
pulse generator. The write pulse generator is not a standard 
pulse circuit. It was found that, if the control grid was 
raised to ground potential and the screen grid raised to 60 to 
70 volts, then a current pulse of 4 to 4.5 milliamperes would 
be obtained. If this circuit were to be designed again, a 
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coincidence gate of the type used for the multiplier circuits 
described in Section D of this chapter would be used. The 
present circuit works satisfactorily, however. 

The quantizing circuit is used as one control for the 
write puls© generator, the previously described one-shot multi¬ 
vibrator being the other control. The quantizer takes all 
positive input voltages Of any amplitude and makes them of 
sufficient amplitude to raise the control grid of the write 
pulse generator from -19 volts (below cut-off) to ground poten¬ 
tial. Negative input voltages have no effect since they work 
to keep the write pulse generator cut off. Consideration was 
given to the use of a Schmitt trigger circuit (15» 22) to 
accomplish quantization. The Schmitt trigger tends to switch 
at different values, depending upon the direction from which 
the cross-over value is approached. This hysteresis affect 
makes very careful design necessary to reduce it to an accepta¬ 
ble amount; therefore, a simpler method was evolved. The high 
gain saturating amplifier (V8), shown in Fig. 3-4, will raise 
the pentode control grid (V7) to 0 volts, with inputs as small 
as 0.1 volt positive at frequencies as low as 4 cycles per 
second. The voltage at the pentode grid does not go above 
0 volts because of clipping by grid current through a 1 meg-ohm 
resistor. Adjustment of circuit parameters can be made to 
cause the circuit to be more sensitive if desired. The quan¬ 
tizing circuit is d.c. coupled to the write pulse generator 
control grid. 

D. OUTPUT CIRCUITS 

The previous circuits take analog information; convert it 
to digital form (one bit or two levels); pass it into the mag¬ 
netic core shift register; and control the advance of informa¬ 
tion through the register. Now this information must be taken 
out of the register and used to form the correlation function. 
Figure 3-5 shows one of the ten output channels which form 
points on the correlogram. The pulse available at terminal 1 



122 


of each core is pictured in Fig. 3~2. The output from each core 
is RC coupled to a 12AX7 twin-triode amplifier. The first stage 
of this amplifier is biased 4 volts below the - 3.5 volt out-off 
voltage. This is necessary to furnish absolute discrimination 
against ZERO’S when they are present in the core. A ZERO 


-100V. +225V. -100V 



actually results in an output voltage of 2 or 3 volts at 
terminal 1 of each core (see Fig. 3"6c). This voltage will not 
bring the first stage of the amplifier out of cut-off. A ONE 
results in an output of 15 volts which not only brings the tube 
into conduction but will go beyond, to a point where grid 
current is drawn. The large resistor in the grid circuit 
results in sharp clipping and keeps loading of the core at a 
minimum when the grid reaches zero volts. After another stage 
of amplification, the triangular core output pulse has been 
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Pulse into averaging circuit 

square size: 20 volts 

1 microsecond 


Train of pulses into averaging 
circuit (channel 3) 

square size: 20 volts 

1 millisecond 


Train of output pulses at core r 0 

square size: 5 volts 

1 millisecond 


Input pulses to grid if 3 of 
multiplier 

square size: 20 volts 

200 microseconds 


Input pulses to grid -1 of 
multiplier 

square size: 5 volts 

200 microseconds 


Fig. 3-6 Waveforms for Sinusoidal Input 
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shaped into a fairly rectangular pulse (Fig. 3~6e).* This 
pulse is d.c. coupled to the control (first) grid of a 6AS6 
pentode coincidence gate. 

The last core is connected to another two stage high gain 
amplifier in addition to the one described in the previous para 
graph. The first stage of this amplifier is biased 4.5 volts 
below the cut-off value which for this tube (6SL7) is approxi¬ 
mately -4 volts. The result is a slightly narrower pulse at 
the output of this amplifier than was obtained from the 12AX? 
amplifier since it was obtained closer to the top of the tri¬ 
angular input pulse (Fig. 3“<>d). The rectangular pulses are 
approximately 35 microseconds wide for the first described 
amplifier and 45 microseconds for the latter amplifier. The 
6SL7 amplifier is coupled to the third (suppressor) grid of the 
6AS6 co incidence gate in each of the ten channels. 

Pulses at the two controlling grids of the 6AS6 coinci¬ 
dence gates raise both of these grids from a large negative 
voltage up to zero volts. When this occurs at both grids simul 

taneously , an output pulse occurs at the plate of the coinci¬ 

dence gate. This is equivalent to a 1 x 1 = 1 multiplication. 
Under any other circumstances (l x 0 or 0 x 0), no output will 
occur. The width of the output pulse is controlled by the 
width of the narrower of the two pulses. This is the pulse 

from the 6 SL7 amplifier whose output is common to all channels. 

The result is uniformity in the width of pulses from all ten 
multipliers (coincidence gates). The negative output pulses 
from the multipliers have an amplitude^ of approximately 55 
volts. (See Figs. 3"6a and 3-6b.) It will be noted that care¬ 
ful selection of tubes and operating points insures that no 
output occurs for zeros. Compare Figs. J-6b and 

The output pulses from each multiplier are fed to an 
averaging circuit in the same channel. The circuit is the 
counting rate meter discussed in Chapter II. A derivation for 

* In Figs. 3-6d and 3-6e the time scale is reversed, increas¬ 
ing time going to the left. 
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the response of this circuit to a train of input pulses is 
given in Appendix II. Parameters (R,, and C^) for this oircuit 
were chosen so that, at sampling frequencies up to 10 kc, out¬ 
put voltage would be less than one tenth the magnitude of the 
input voltage pulses. This is necessary for linearity of 
integration. The time constant of the averaging filter may be 
altered by varying the effective size of C 2 ^ It was noted 
previously that the quantizer acted as a high pass filter with 
a break poiint 3>t approximately 12*5 radians per second. This 
has the effeet of eliminating very slow signal variations such 
as might occur in a non-stationary random input signal, but it 
also makes necessary the measurement of the average value by 
other means such as a d.c. voltmeter. An averaging filter time 
constant of 1 second would show a noise-to-signal ratio of 
approximately 0.3 for continuous averaging. Samples are being 
Used here indicating the need for a longer averaging time. For 
an input with a zero mean, a sampling rate of 8 kcs would cause 
approximately 4,000 samples to be accumulated every second at 
t = 0. Lesser numbers would be accumulated for other values of 
t. In the last analysis it becomes a matter of trying out 
different averaging times and looking at the results to deter¬ 
mine what is satisfactory. 

A measurement of the back resistance of the IN93 germanium 
diodes was made and indicated that shunting effect on the 
averaging circuit is negligible (with a back voltage of 100 
volts, the diodes pass only about 30 microamperes). 

E. DISPLAY CIRCUIT 

A few possible arrangements for displaying the correlogram 
were discussed in Chapter II. More detailed information on a 
diode matrix display is given in Appendix III. For the present 
thesis work, only two output channels were constructed. These 
channels were connected to various magnetic cores with a probe, 
and the output was read with a vacuum tube voltmeter. 
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The construction of tbn duplicate Channels and an 
associated switching and display circuit was not vital tb this 
investigation. Schemes for doing this have been devised. If 
simplicity was the most important factor, each core could be 
connected through a hand-operated selector switch to a single 
output channel. The value for each channel could be obtained 
from a meter reading in about ten seconds. It would be neces¬ 
sary to maintain oontact long enough for the average to be 
formed. Two dozen points could be recorded in about four 
minutes. If it is desired to make the display automatic, and 
faster, the equipment becomes comparatively complicated. A 
separate channel must be constructed for each point on the 
correlogram so that all averages are continuously ready for 
display. As mentioned in Chapter II, there is now a choice 
between a mechanical and electronic commutator for switching, 
with the decision resting heavily on economic considerations. 

Reserving one channel for horizontal sweep synchronization, 
a 63 -point correlogram using,a diode .matrix would require from 
176 to 384 diodes, depending on the matrix configuration' used 
( 23 ). In addition, a total of at least 76 vacuum tubes or 
transistors would be required. Thus, it might be well to con¬ 
sider using a motor-driven selector switch. Reference (17) 
describes a 22 -point rotary selector switch driven by a step¬ 
ping magnet. This switch may readily be modified for Use with 
44 channels. High-speed mechanical commutators have been 
developed to sample 66 to 100 circuits at speeds up %o 2,000 
rpm; and (24) describes a mercury jet switch which will sample 
120 circuits, 60 times a second. 

Special-purpose commutating tubes, such as the cyclophon 
and radial beam tube, are not considered practical for this 
correlator and are mentioned here only in the interest of .indi¬ 
cating their existence. 



CHAPTER IV 


TESTS AND CONCLUSIONS 

This chapter discusses some of the tests made with the 
correlator to determine its performance. Certain aspects of 
the circuits described in the previous chapter are mentioned 
in relation to their effect on the results. Comparisons are 
made between expeoted results and the actual correlograms 
obtained for inputs such as sinusoids, triangular waves, square 
waves, white noise, and noise shaped by filters. 

The chapter ends with a few comments on the direction that 
circuit development for a one-bit correlator might take, and 
some general conclusions. 

A. CORRELOGRAMS OF PERIODIC FUNCTIONS 

The first correlograms taken were for a sinusoidal input 
from an H.P. Model 202B audio oscillator. Readings were made 
with an RCA voltohmyst junior. Various input frequencies and 
sampling rates were tried. The circuit parameters for the out¬ 
put filter were varied and the effects noted. It is believed 
that Figs. 4-1 and 4-2 can be used to summarize the important 
characteristics of the correlogram for this type of input. The 
output filter was made up of a 100,000 ohm resistor in parallel 
with 4.35 microfarads of oapacitance. Increasing the size of 
the resistor raises the amplitude of the output, thus reducing 
the linearity of integration. To increase the time constant, 
the value of capacitance must be increased. This is disoussed 
at more length in Chapter II, The correlograms for a sinusoid 
can be seen to have oertain properties which are listed below: 

(1) The frequency of the input is accurately- 
indicated . 

(2) The correlogram has a triangular form. 

( 3 ) The amplitude increases with increased sampling 
rate. 
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(k) The output filter voltage slowly fluctuates 
about an average value. 

(5) The minimums are flattened. 

A brief discussion of the properties is made in the para¬ 
graphs that follow. 

There is nothing startling about the fact that the 
correlator reports the frequency of the input signal accurately. 
Of course, the use of two level quantization on the input means 
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Fig. 4-1 Correlograms of Sinusoidal Inputs 


that triangular waves, sinusoids, and square waves all look 
like square waves after quantization. Hence, all of the waves 
will show the triangular autocorrelation function of a square 
wave. This was verified by using a Hewlett Packard function 
generator to furnish all of these inputs. Of course , these 
inputs could be distinguished by the correlator if the cross¬ 
over point of the quantizer were varied or if a d-c level were 
added to the input. In this case the square wave should not 
be affected, but the correlation functions of triangular and 
sinusoidal waveforms will be flattened at the top if a positive 
level is added, and at the bottom if a negative level is added. 

The amplitude of the output is dependent upon properties 
of the counting rate meter, as discussed in Chapter II and 
summarized by equation 2-8. 

There are several things which might cause the output 
amplitude to fluctuate. Drift in the clock frequency would 



129 


cause any given channel to be computing for fluctuating values 
of t. Drift in amplitude or zero value of the input would also 
cause the output to fluctuate since the crossover point in the 
quantizer would be affected. The two stages of the quantizer 
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Fig. 4-2 Correlogram Fluctuations 

have gains of approximately 43 and 57, or a total gain of 
almost 2 $ 500. Thus, by nature it is extremely sensitive to 
input noise, changes in signal strength, and drift in supply 
voltage. Another source of output fluctuation is drift in 
the coincidence gates used for write-in. This may be caused 
by shifts in the clock frequency (thus varying the number of 
samples taken when the input is positive). Any drift in the 
amplitude of pulses from the output multiplier gate will also 
cause the correlation function to fluctuate. Thus, it seems 
that refinement of the circuitry would be the first step in 
reducing the fluctuations. It might be noted that it is fairly 
easy to average, by eye, the output variations indicated on a 
voltmeter. This was done for the correlograms presented herein. 
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The cause of flattening of the mibimums is more difficult 
to explain. The fact that the quantizer shifts at a voltage 
slightly higher than zero volts means that, for a sinusoidal 
input with zero mean, the shift register receives a few more 
ONE 1 s than ZERO *s. The output of the quantizer is a train of 
pulses which do not quite form a square wave. The correlation 
function of such a wave is flattened slightly at the bottom. 

This effect should be less noticeable when the input actually 
is a square wave. This was checked, but flattening at the bot¬ 
tom of the co.rrelogram was not reduced. Therefore, another 
explanation is needed. 

A more likely cause of flattening of a correlogram having 
a triangular shape is inherent in the use of two-level quanti¬ 
zation. The input is two-valued. Van Vleck (25) and Bussgang 
(26) discuss the effect on a correlation function of extreme 
clipping of an input signal so that it is two-valued. They 
show that the actual correlogram is proportional to the arc 
sine of the theoretical correlation function.* This relation¬ 
ship will translate a straight slope into a curve that is steep 
at maximuras and somewhat flattened at rfiinimums-. This effect is 
quite apparent in Fig. 4-1. 

B. CORRELOG-RAMS OF RANDOM FUNCTIONS 

White noise from a Scott noise generator, Type 810-A, was 
used to determine the response of the correlator to random func¬ 
tions. The test equipment arrangement is shown in the block 
diagram of Fig. 4-3a. The noise generator furnished noise in 
a range 20 ops to 20 kcs. The McIntosh 20 W-2 amplifier has a 
response within -0.2 db over the same range. The filter cir¬ 
cuit and its measured transfer function are shown in Fig. 4-3b 
and 4-3c , respectively. The filter Characteristic was measured 
with input and output impedance connectiohs, the same as those 
present in the test circuit. 


* See Appendix V 
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Correlograms were made with a white noise input and with 
a band limited noise input. 

1. White Noise 

The circuit for this test is shown in Fig. 4~3 a where the 
filter bypass switch is closed. The results are summarized by 
the curves on the lower half of Fig. 4-4. Variation in the 
gain setting of the McIntosh amplifier results in a change of 
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Fig. 4-3 Test Equipment Arrangement and Filter Character¬ 
istics 


the mean square value of the input but in no change in the form 
of the correlation function. This is as expected. The auto¬ 
correlation function of true white noise of infinite bandwidth 
is an impulse. The correlogram shows the noise here to be vir¬ 
tually uncorrelated for t shifts greater than 150 microseconds. 

2• Band-limited Noise 

According to Wiener*s theorem, the autocorrelation 
function of a random signal is the Fourier cosine transform of 
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its power density spectrum. Therefore, by shaping the power 
density spectrum with filters of known characteristics, the 
theoretical autocorrelation function may be computed. Thus, 
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Fig. 4-4 Amplifier Gain Effects on Correlograms of Noise 
Input s 


if white noise were band limited by an ideal rectangular filter, 
the resulting correlation function would have the form* 


R 11< T > - K ( 


w^ sxn w^ t 


W 2 T 


w^ sin t 

w^ T 


4-1 


where is the higher of the two frequency limits and K is a 
constant. Since the above filter is not realizable, a more 
practical formula is the following one which is developed in 

(27). 
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* See Appendix IV. 
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where w Q is the resonant frequency of a high Q circuit. Both 
formulas describe curves which are similar in general shape. 

Reference to the filter characteristic of Fig. 4~3c show 
that the filter used for tbqse tests had a Q of approximately 
8. Thus, according to equation 4-2, R.^ ( t ) I s a decaying 

cosine wave which should 
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Fig. 4-5 Effects of Sampling 
Rate on Correlograms of Band 
Limited Noise 


decrease to half value in 
a little over 1,100 micro¬ 
seconds. 

Figure 4-5 shows the 
correlograms obtained using 
the circuit arrangement of 
Fig. 4-3a for various corre¬ 
lator sampling rates. Increas¬ 
ing the sampling rate increases 
the gain and the detail, while 
shortening the total range of 
t that is obtained. There 
appear to be frequency compo¬ 
nents of 1 kcs and 2 kcs super¬ 
imposed in the correlogram. 

The frequency expected accord- 
to equation 4-2 is approxi¬ 
mately 1«600 cps. The maximum 
value occurs for t = 0, as 
anticipated, but the curves do 


not decay as predicted. It is felt that a longer shift regis¬ 


ter, furnishing a greater range of t, is needed to make a more 


detailed comparison of experimental and theoretical results. 


C. COMMENTS ON POSSIBLE CIRCUIT IMPROVEMENTS 

Previous comments showed -the possibility of correlogram 
errors due to the quantizer. The coincidence gate used for 
write-in may only do a partial job if the input changes polar¬ 
ity during the time of the sampling pulse. A more stable clock 
would be desirable to make free from drift the values of t 
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which each magnetic core represents. The output multiplier 
seems to be satisfactory although pulses of higher amplitude 
would be desirable. These comments do not get to the real 
center of the problem, howbver. A one-bit multichannel corre¬ 
lator shows promise of furbishing useful correlograms with a 
minimum of equipment and time. The most important step seems 
to be the minimization of equipment bulk by use of transistors. 

It is believed that all of the circuits could be readily 
transistorized with the possible exception of the shift pulse 
generator which must furnish large currents. This problem 
might be lessened by proper selection of the magnetic cores 
which make up the shift register. 

The magnetic core shift register operates very well as a 
delay line. It does not have the attenuation present in arti¬ 
ficial lines, and it is almost as accurate in time as the clock 
that regulates it (small time variations in the output from 
individual cores are possible). 

D. CONCLUSIONS 

The principal conclusion is that a two-level correlator 
is a useful device. It is the ultimate in simplicity and fur¬ 
nishes recognizable correlograms 1 in a minimum of time. With 
the circuits used in this investigation, only 10 vacuum tubes, 
exclusive of power supply requirements, are needed to furnish 
one channel. Two additional tubes are required for each addi¬ 
tional channel. A true real time correlator would require a 
channel for each value of t and would also require a switching 
circuit. These requirements necessarily add to the bulk and 
cost of the equipment , but it would still be simple compared 
to correlators presently in existence. 

If one were dealing with signals which were stationary 
over a period of a few minutes, a simple one-channel correlator 
with a hand-operated switch to move from core to core in the 
shift register could be used to quickly obtain a dozen or more 
points on a correlogram (see Chapter III). One then has a 
portable correlator that oan be wheeled around as easily as an 
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oscilloscope or wftve analyzer. Such a correlator could be 
Useful in obtaining immediate results from bioelectric signals, 
music , speech; or it might be used as an inexpensive olassroom 
or laboratory demonstrator in the study of statistical 
functions. 

As experience with a two-level correlator is gained, it 
should be possible to obtain more information with this corre¬ 
lator, than might at first appear possible. For example, it was 
pointed out earlier that by varying the crossover point of the 
quantizer, square waves, sinusoids, and triangular waves may b€ 
distinguished. This would not be possible with two-level quan¬ 
tization without this simple artifice. 

It is felt that the results indicated in this thesis 
warrant construction of two-level (one-bit) correlators, i'he 
magnetic core shift register is an excellent delay and tempo¬ 
rary storage device for such correlators. 
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DERIVATION OP INPUT-OUTPUT RELATIONSHIPS 
FOR TWO BASIC INTEGRATORS 


Notation follows that in Fig. 2-4. 


A. MILLER INTEGRATOR 
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Combining the abovfc relations gives the following 
expression: 
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If a series expansion were made of the expression for the 
Miller Integrator where -K —♦ oo, the result would approaoh the 
expression for the Bootstrap Integrator. 



APPENDIX II 


A DERIVATION FOR THE IMPULSE RESPONSE 
OF THE COUNTING RATE METER 


Notation follows that of Fig. 2-5. 

Each pulse charges C, to a value E, 
therefore the following equivalent 
circuit applies provided R » V. The 
width of the input pulses is assumed 
co be negligible in this derivation. 
For a single input pulse 
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Fig. A-l Low-Pass Filter 
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The input train of pulses is 
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where T is the sampling period. 
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Then , 
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where t = R^C^. 


The residue in the pole at -1 /t is 
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Removing the pole at -1/t from the previous expression, we have 
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The first term in the resulting expression represents a pulse, 
and the second term represents repetition of this pulse. The 
form of the first term may bu rearranged as follows: 
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This pulse has the following form (see Fig. A-2a) after rein¬ 
serting the amplitude factor C^E/Cg* The total response V(t) 
is then a string of the above pulses added to the response for 
the pole which was previously reihoved. The final result has 
the following form (see Fig. A-2b) 



Fig. A«-2 Counting Rate Meter Output Voltage Waveform 


The foregoing discussion shows the manner in which pulses 
occurring periodically would charge the output capacitor G^. 

If the input pulses occurred randomly with an average rate n, 
then Campbell^ theorem may be used to show the fluctuation of 
V(t) about its final value V = nC^ERg. (15) 

oo 
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where V is the average value of V(t). The response to a single 
pulse at t = 0 

C 1 "" t / R 2 C 2 
= n~ E e 

C 2 


V(t) 


for t > 0 



Substituting in the previous expression, the result is 
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The relative error is then 
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* This corrects an error irt Reference (15) at - this step. 



APPENDIX III 


A DIODE MATRIX SWITCHING CIRCUIT 


A block diagram of this circuit, simplified for seven 
values of t and a channel for oscilloscope synchronization, 
is shown in Fig. A-3. A complete description of a similar 



Fig. A-3 Block Diagram of Diode Matrix Switching System 


switching system may be found in (12) and ( 13 ). Details 
concerning the operation of a diode matrix may- be found in ( 23 ). 
The coincidence gates are biased to cut-off until the diode 
matrix places a zero or slightly positive voltage on the sup¬ 
pressor grid. This is done sequentially by action of a chain 
of flip-flop multivibrators on the matrix. The amount of con- 
duction from each coincidence gate is then controlled by the 
voltage which one of the output filters maintains on the con¬ 
trol grid. Thus, the output to the oscilloscope takes on 
voltages, in time sequence, which are determined by the various 
output filter voltages. Figure A -3 shows some of the detail 
for channel 4. 
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One of the outputs from the matrix is used to synchronize 
the horizontal sweep of the oscilloscope. The entire switching 
circuit may be synchronized by the dock in the shift pulse 
source although this is not essential. 


* 



APPENDIX IV 


CALCULATION OF AUTOCORRELATION FUNCTION 
OF BAND LIMITED NOISE 
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Fig. A-4 Power Spectrum of 
White Noise Passed Through an 
Ideal Band-Pass Filter 


If an ideal band pass filter 
were realizable, the power 
spectrum of white noise might 
be shaped as shown below. 

Now, according to Wiener's 
theorem 
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Tn this case then 


R i;l (t) = 2A J 


cos UT dw 


2A 


sin u)t 


= 2A 


( sin w 2 t sin T\ 

i 


sin w. 


Actually of course such a filter is not realizable, 
it can be shown (2) that 


However, 


$ xl (w) = H(w) 




This takes into account the filter frequency characteristic 
Il(w). For white noise $^(w) is a constant. Equation 4-2 
is derived from this last relationship. 
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APPENDIX V 


CORRELATIONS OF TWO LEVEL NOISE SIGNALS ( 25 ) 

Given two signals X and Y having Gaussian amplitude 
distributions, the joint probability that X lies between 
X and X + dX and that Y lies between Y and Y + dY is 


-(X 2 + y 2 - 2 rXY) / 2(l-r) dX dY 
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where r = XY. The correlation function is then found by using 
this expression in formula 1-2 of the first chapter. 

If X and Y are two valued ( - l), the correlation function 
is given by 

(*° r m 


R(t) = 


2tt 






L o o 


e~ a dX dY + 


r r.- 


— 00 -"00 


dX dY 


oo 


00 


-I I 


e" a dX dY 


0 -00 


- oo o 


e" a dX dY 


where 


a = 


(X 2 4 Y 2 — 2 rXY) 


2 (1 - r ) 

If polar coordinates X = p cos cp and Y = p sin cp are 
introduced, the above expression can be written as 


tt/2 oo 

R(t) = 4 J* depj . jz 


-o 2 


P (1-r sin 2tp) 
2 (1-r 2 ) 


o 2tt 




P *P “ 1 


jl - r 2 

TT 


I 


.tt/2 


dep 


1-r sin 2<p 


t 2 a _1 

- 1 = — sin r 

IT 


which says that the correlation function of the two-valued 
signal is 2/tt times the arc sine of the continuous (unclipped) 
correlation function. 
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